-- Logs begin at Wed 2022-09-28 07:58:16 UTC, end at Wed 2022-09-28 09:05:19 UTC. -- Sep 28 08:28:32.450540 dv-cinder-844563-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 28 08:28:32.460360 dv-cinder-844563-8-smb devstack@keystone.service[81832]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 08:28:32 2022] *** Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: nodename: dv-cinder-844563-8-smb Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: machine: x86_64 Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: clock source: unix Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: pcre jit disabled Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: detected number of CPU cores: 4 Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: current working directory: / Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: detected binary path: /usr/bin/uwsgi-core Sep 28 08:28:32.462330 dv-cinder-844563-8-smb devstack@keystone.service[81832]: your processes number limit is 47680 Sep 28 08:28:32.463077 dv-cinder-844563-8-smb devstack@keystone.service[81832]: your memory page size is 4096 bytes Sep 28 08:28:32.463077 dv-cinder-844563-8-smb devstack@keystone.service[81832]: detected max file descriptor number: 2048 Sep 28 08:28:32.463077 dv-cinder-844563-8-smb devstack@keystone.service[81832]: lock engine: pthread robust mutexes Sep 28 08:28:32.463077 dv-cinder-844563-8-smb devstack@keystone.service[81832]: thunder lock: enabled Sep 28 08:28:32.463077 dv-cinder-844563-8-smb devstack@keystone.service[81832]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 28 08:28:32.463077 dv-cinder-844563-8-smb devstack@keystone.service[81832]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 08:28:32.502749 dv-cinder-844563-8-smb devstack@keystone.service[81832]: Python main interpreter initialized at 0x55843f6a19c0 Sep 28 08:28:32.502749 dv-cinder-844563-8-smb devstack@keystone.service[81832]: python threads support enabled Sep 28 08:28:32.502749 dv-cinder-844563-8-smb devstack@keystone.service[81832]: your server socket listen backlog is limited to 100 connections Sep 28 08:28:32.502749 dv-cinder-844563-8-smb devstack@keystone.service[81832]: your mercy for graceful operations on workers is 90 seconds Sep 28 08:28:32.503097 dv-cinder-844563-8-smb devstack@keystone.service[81832]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 08:28:32.503183 dv-cinder-844563-8-smb devstack@keystone.service[81832]: *** Operational MODE: preforking *** Sep 28 08:28:32.503407 dv-cinder-844563-8-smb devstack@keystone.service[81832]: *** uWSGI is running in multiple interpreter mode *** Sep 28 08:28:32.503407 dv-cinder-844563-8-smb devstack@keystone.service[81832]: spawned uWSGI master process (pid: 81832) Sep 28 08:28:32.503623 dv-cinder-844563-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 28 08:28:32.504200 dv-cinder-844563-8-smb devstack@keystone.service[81832]: spawned uWSGI worker 1 (pid: 81844, cores: 1) Sep 28 08:28:32.504520 dv-cinder-844563-8-smb devstack@keystone.service[81832]: spawned uWSGI worker 2 (pid: 81845, cores: 1) Sep 28 08:28:32.506314 dv-cinder-844563-8-smb devstack@keystone.service[81832]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 08:28:36.888513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:28:36.888513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: from cryptography.utils import int_from_bytes Sep 28 08:28:36.889310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:28:36.889310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: from cryptography.utils import int_from_bytes Sep 28 08:28:36.889555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:28:36.889555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: from cryptography.utils import int_from_bytes Sep 28 08:28:36.890022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:28:36.890022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: from cryptography.utils import int_from_bytes Sep 28 08:28:36.941219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 08:28:36.941352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 08:28:36.941446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 08:28:36.941535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 08:28:36.941617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] command line args: [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 08:28:36.941690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] command line args: [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 08:28:36.941848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 08:28:36.941939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 08:28:36.942016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ================================================================================ {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 08:28:36.942088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ================================================================================ {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 08:28:36.942270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] admin_token = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.942356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] admin_token = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.942516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] config_dir = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.942605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] config_dir = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.942708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.942794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.942891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] config_source = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.942969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] config_source = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.943071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] debug = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.943161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] debug = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.943270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.944843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.944843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] list_limit = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.945928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] list_limit = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] log_config_append = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] log_config_append = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] log_dir = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] log_dir = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] log_file = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] log_file = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.946971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.947965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.948995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] publish_errors = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] publish_errors = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.949997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] standard_threads = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] standard_threads = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.950987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] use_journal = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] use_journal = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] use_json = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] use_json = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] use_stderr = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] use_stderr = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.951953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] use_syslog = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.952036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] use_syslog = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.952116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.952188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:28:36.952257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.952371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.952477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.952556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.952739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.952825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.952978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.953957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.954933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.955015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.955176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.955258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.955411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.960380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.960380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.960666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.960747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.960819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.960889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.960972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.961927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.962940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.963982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.964929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.965012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.965078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.965136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.965194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.965976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.966929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.967005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.967076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.967148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.967768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.967894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.967976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.968977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.969969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.970939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.971926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.972930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.973975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.974919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.975854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.976990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] auth.external = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] auth.external = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.977946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] auth.password = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] auth.password = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] auth.token = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.978991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] auth.token = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.979961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] credential.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.980910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] credential.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.981889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.982852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.983569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.983811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.983915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.984943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.985934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.986883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.987876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.988037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.988629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.988629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.988748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.988807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.988877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.988948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.989950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.990907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.991876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.992871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.993943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.994963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.995984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996110 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.996883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.997973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.998086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.998326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.998405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.998624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.998757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.998879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.998957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:36.999909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.000863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.001986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.002990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.003961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.004924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005319 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.005935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.006966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007767 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.007924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.008953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.009897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.010856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011323 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] role.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.011994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] role.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] role.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] role.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.012939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.013999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.014224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.014368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.014447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.014633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.014713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.014872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.014950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.015124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.015202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.015662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.015744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.015921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.016088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.016163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.016325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.016556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.016635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.016795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.016874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.017859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.018945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.019990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.020229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021794 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.021935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.022846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.023994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024709 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.024955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.connection = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.025931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.connection = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.026955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.027919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.028854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.029015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.029093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.029287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.029377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.029451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 08:28:37.029523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.030389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.030636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.031011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.031252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:28:37.031441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 08:28:37.059545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.059776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.060004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.063147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.063401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.063639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.069113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.077674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.098238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.098470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.104001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.104235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.159577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.159830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.207673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.207896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.208041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.208185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.365374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.365664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.365804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.365941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.366975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.389073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.389812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.389949 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.390079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.390187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.390600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.390726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.390892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.391059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.391202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.391331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.391491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.391621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.391748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.402352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.405805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.417867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.418934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.419026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.419152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.419235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.419370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.419622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 28 08:28:37.436556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.436913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 08:28:37.437261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.437468 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 08:28:37.437746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.438011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.438273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.438537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.442570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.442785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 08:28:37.443132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.443397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 28 08:28:37.446165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.446701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.446701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.446966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.448212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.450989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.450989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.450989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.457014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.457263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.457545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.457818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.458105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.459953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.460243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.460533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.460934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.461222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.461490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.461764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.462041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.462315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.462590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.462860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.465091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.468079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.468477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.468769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.469053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.469340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.469606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.469881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.470157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.470430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.470703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.470972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.489487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.490699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.490994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.493825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.495293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.495612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.495710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.495959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.496245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.500920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.501212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.501502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.503137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.503525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.509164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.509461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.509747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.510031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.510309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.510587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.510858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.511128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.512160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.512451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.519440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.519737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.520028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.520319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.520602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.520882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.521154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.521423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.527622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.527904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.531807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.535049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.535347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.537276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.537553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.539599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.541455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.542724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.544749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.545045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.546142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.546442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.546732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.547019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.547322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.547641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.549404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.552564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.555803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.556103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.556386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.556669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.556947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.557228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.564140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.564426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.564697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.564964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.571836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.573388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.573515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.573689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.573961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.574227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.574912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.575190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.578598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.578885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.579172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.579502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.579905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.581624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.583146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.584685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.584964 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.587788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.588077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.588361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.588647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.589045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.591064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.591357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.591669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.591956 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.592383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.592763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.593049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.600363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.600643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.600926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.601209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.601598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.601880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.602171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.608515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.611443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.614361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.615864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.617336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.617622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.617834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.618028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.620806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.624295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.624973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.625793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.626427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.627259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.627572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.627981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.629325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.629726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.630010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.630286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.634438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.635941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.638114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.638409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.638693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.638818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.639969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.640525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.644339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.646450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.646749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.647017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.647310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.647611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.647889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.648164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.648443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.648724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.648804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.649002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.649094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.649292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.649373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.649552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.649816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.650087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.656265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 28 08:28:37.656550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.656831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.657108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.657549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.657837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.658243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.658425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.658712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.658996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.659272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.659578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.659862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.660137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 28 08:28:37.684124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55843f6a19c0 pid: 81844 (default app) Sep 28 08:28:37.688029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cff57-af32-4eb3-9f38-6211dae2aaa5 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:37.688317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cff57-af32-4eb3-9f38-6211dae2aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:37.688590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cff57-af32-4eb3-9f38-6211dae2aaa5 None None] PATH_INFO: `/v3` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:37.692812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Wed Sep 28 08:28:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:28:37.695063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55843f6a19c0 pid: 81845 (default app) Sep 28 08:28:45.477796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff920ea-9e4d-4643-955b-e5d38752af5c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:45.478291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff920ea-9e4d-4643-955b-e5d38752af5c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:45.478364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff920ea-9e4d-4643-955b-e5d38752af5c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:45.479691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:45.488121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:45.488570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:45.488662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:45.559768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: INFO dbcounter [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] Registered counter for database keystone Sep 28 08:28:45.579001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG oslo_db.sqlalchemy.engines [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:28:45.585092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writer thread running {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:28:45.790595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG passlib.handlers.bcrypt [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81845) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 28 08:28:45.790989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG passlib.handlers.bcrypt [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81845) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 28 08:28:45.849013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:45.850620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:45.987608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 28 08:28:46.450561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff920ea-9e4d-4643-955b-e5d38752af5c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:46.519761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: INFO dbcounter [None req-9ff920ea-9e4d-4643-955b-e5d38752af5c None None] Registered counter for database keystone Sep 28 08:28:46.541019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG oslo_db.sqlalchemy.engines [None req-9ff920ea-9e4d-4643-955b-e5d38752af5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:28:46.547751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writer thread running {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:28:46.664982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff920ea-9e4d-4643-955b-e5d38752af5c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:46.669201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783c7f0-fd04-41b4-8cde-5e8b13751f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:46.669810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c7f0-fd04-41b4-8cde-5e8b13751f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:46.670673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c7f0-fd04-41b4-8cde-5e8b13751f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:46.670971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c7f0-fd04-41b4-8cde-5e8b13751f71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:46.679063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783c7f0-fd04-41b4-8cde-5e8b13751f71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:46.729517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5783c7f0-fd04-41b4-8cde-5e8b13751f71 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 28 08:28:46.729801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783c7f0-fd04-41b4-8cde-5e8b13751f71 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:46.739747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Sep 28 08:28:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 08:28:46.745653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:46.762453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40621d1-dac6-4efd-a6df-984e67da1abe None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:46.767471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6edd64-f7e0-4829-9448-942c6037a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:46.768705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6edd64-f7e0-4829-9448-942c6037a3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:46.768987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6edd64-f7e0-4829-9448-942c6037a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:46.769258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6edd64-f7e0-4829-9448-942c6037a3a6 admin admin] PATH_INFO: `/v3/projects/42006892efe04f19b84a31bfb4dc5f4b` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:46.770689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6edd64-f7e0-4829-9448-942c6037a3a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=42006892efe04f19b84a31bfb4dc5f4b)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:46.823089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a6edd64-f7e0-4829-9448-942c6037a3a6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 28 08:28:46.823448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6edd64-f7e0-4829-9448-942c6037a3a6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:46.828554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Sep 28 08:28:46 2022] GET /identity/v3/projects/42006892efe04f19b84a31bfb4dc5f4b => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:28:48.936307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310632-2d07-4eeb-9e88-2b2b952f6d29 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:48.936733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310632-2d07-4eeb-9e88-2b2b952f6d29 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:48.936859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310632-2d07-4eeb-9e88-2b2b952f6d29 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:48.941031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:48.951049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b603d54-f7b4-4cfd-92b2-3cf4d98823ca None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:48.951876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b603d54-f7b4-4cfd-92b2-3cf4d98823ca None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:48.951876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b603d54-f7b4-4cfd-92b2-3cf4d98823ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:48.973357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-6b603d54-f7b4-4cfd-92b2-3cf4d98823ca None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:48.974859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6b603d54-f7b4-4cfd-92b2-3cf4d98823ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:48.982550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 28 08:28:49.246557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310632-2d07-4eeb-9e88-2b2b952f6d29 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:49.258519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310632-2d07-4eeb-9e88-2b2b952f6d29 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:49.262653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9bd66-11ea-4bc5-8653-f0da5f90a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:49.263249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9bd66-11ea-4bc5-8653-f0da5f90a9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:49.263575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9bd66-11ea-4bc5-8653-f0da5f90a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:49.264358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9bd66-11ea-4bc5-8653-f0da5f90a9d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:49.272123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9bd66-11ea-4bc5-8653-f0da5f90a9d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:49.273879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9bd66-11ea-4bc5-8653-f0da5f90a9d7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:49.283080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Sep 28 08:28:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:28:49.288356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b603d54-f7b4-4cfd-92b2-3cf4d98823ca None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:49.297249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b603d54-f7b4-4cfd-92b2-3cf4d98823ca None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:49.301543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2825b-8b19-461a-ba4e-007357d28d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:49.302153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2825b-8b19-461a-ba4e-007357d28d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:49.302430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2825b-8b19-461a-ba4e-007357d28d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:49.302698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2825b-8b19-461a-ba4e-007357d28d1e admin admin] PATH_INFO: `/v3/users/b229946b8c534cd194a31028b1b40cec` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:49.304011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2825b-8b19-461a-ba4e-007357d28d1e admin admin] RBAC: Authorizing `identity:get_user(user_id=b229946b8c534cd194a31028b1b40cec)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:49.305812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2825b-8b19-461a-ba4e-007357d28d1e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:49.307301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Sep 28 08:28:49 2022] GET /identity/v3/users/b229946b8c534cd194a31028b1b40cec => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:28:51.545465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3110-445d-49b8-b990-456541843bb5 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:51.546245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3110-445d-49b8-b990-456541843bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:51.546530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3110-445d-49b8-b990-456541843bb5 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:51.547949 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:51.553175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d020-ab7f-4382-9dc1-e001c25658d3 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:51.553572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d020-ab7f-4382-9dc1-e001c25658d3 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:51.553847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6d020-ab7f-4382-9dc1-e001c25658d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:51.569961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1fde8-3fb6-4c73-93a6-3f95ded85990 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:51.570243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1fde8-3fb6-4c73-93a6-3f95ded85990 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:51.570517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1fde8-3fb6-4c73-93a6-3f95ded85990 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:51.571849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 7/11] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:28:51.572438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-afd6d020-ab7f-4382-9dc1-e001c25658d3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:51.573627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-afd6d020-ab7f-4382-9dc1-e001c25658d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:51.577159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:51.577433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:51.577701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:51.619546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG passlib.handlers.bcrypt [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81844) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 28 08:28:51.619937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG passlib.handlers.bcrypt [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81844) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 28 08:28:51.654852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:28:51.669298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:51.671541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:51.772075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:28:51.929862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6d020-ab7f-4382-9dc1-e001c25658d3 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:51.955861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:52.034314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6d020-ab7f-4382-9dc1-e001c25658d3 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.043500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:52.069037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.069671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.069954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.070231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.082011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:28:52.090917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:28:52.092026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:28:52.093085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 6/14] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:28:52.097937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:52.146240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d761-1726-46a8-8d04-81367d0907d5 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.148517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:52.181917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:52.184472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.185341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.186457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.186897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.200808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab8a0-1d85-438b-9337-7758a9bb2a95 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.235443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.236235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.236610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.237022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.237730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:28:52.238069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:52.239522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:52.251790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 7/15] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:28:52.254775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:52.256465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:52.257444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:52.353237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:28:52.355178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ff9fd-983c-4224-8641-e26f732675c4 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.359452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:52.362131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:52.390066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.390685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.390961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.391230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] PATH_INFO: `/v3/users/b229946b8c534cd194a31028b1b40cec` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.392391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b229946b8c534cd194a31028b1b40cec)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:52.393845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:52.395378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 8/17] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:28:52 2022] GET /identity/v3/users/b229946b8c534cd194a31028b1b40cec => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:28:52.401021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:52.415343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:52.455991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e65d-d24b-44cc-a6dc-5e012bffa763 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.489844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.490708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.491000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.491277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.502731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e46c-6a00-411a-8b1a-17f8e09c59b8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.510078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:52.511654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:28:52.532156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:28:52.533072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:28:52.534087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:28:52.534087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:28:52.534087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:28:52.534087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:28:52.536034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.536664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.536943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.537215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.538325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:52.538982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:52.539789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:52.541314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:28:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:28:52.547520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:52.596561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:52.627055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:52.640825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b8b3-1372-4c3f-afe3-6bcea40588ee None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.645774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efef50e-1b59-4d1f-ae59-608d8608730f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:52.674955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fdc96-5ae9-4814-92e1-69191dbbc9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.675599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fdc96-5ae9-4814-92e1-69191dbbc9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.675878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fdc96-5ae9-4814-92e1-69191dbbc9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.676152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fdc96-5ae9-4814-92e1-69191dbbc9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.676790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fdc96-5ae9-4814-92e1-69191dbbc9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:28:52.677150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fdc96-5ae9-4814-92e1-69191dbbc9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:52.678526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fdc96-5ae9-4814-92e1-69191dbbc9e1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:52.680263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab466fe-2d59-49d2-99ec-ac3e92bcd88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:52.680871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab466fe-2d59-49d2-99ec-ac3e92bcd88e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:52.681148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab466fe-2d59-49d2-99ec-ac3e92bcd88e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:52.681421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab466fe-2d59-49d2-99ec-ac3e92bcd88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:52.682176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab466fe-2d59-49d2-99ec-ac3e92bcd88e None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.domain.id=default, user.id=b229946b8c534cd194a31028b1b40cec) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:28:52.682483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab466fe-2d59-49d2-99ec-ac3e92bcd88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:52.683929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab466fe-2d59-49d2-99ec-ac3e92bcd88e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:52.690476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1322 bytes} [Wed Sep 28 08:28:52 2022] GET /identity/v3/role_assignments?user.id=b229946b8c534cd194a31028b1b40cec&scope.domain.id=default&role.id=8b22e1c1112547309cda07f916d1a452 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:28:52.696238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:28:55.211890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6673ee-3a81-4e48-83b0-f2496a529736 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.212377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6673ee-3a81-4e48-83b0-f2496a529736 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.212377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6673ee-3a81-4e48-83b0-f2496a529736 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:55.213753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:55.220592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3183-3d86-475b-99b1-e692c1e66c22 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.221125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3183-3d86-475b-99b1-e692c1e66c22 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.221125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3183-3d86-475b-99b1-e692c1e66c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:55.249366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-900f3183-3d86-475b-99b1-e692c1e66c22 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:55.250599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-900f3183-3d86-475b-99b1-e692c1e66c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:55.349841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:28:55.424869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c95e4-5bfd-4309-b79d-497255c5aa1b None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.425509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c95e4-5bfd-4309-b79d-497255c5aa1b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.426013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c95e4-5bfd-4309-b79d-497255c5aa1b None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:55.427569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:55.432866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2631c19-944b-4182-94ca-10e94abe0ea9 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.433156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2631c19-944b-4182-94ca-10e94abe0ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.433436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2631c19-944b-4182-94ca-10e94abe0ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:55.460892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a2631c19-944b-4182-94ca-10e94abe0ea9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:55.462149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a2631c19-944b-4182-94ca-10e94abe0ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:55.522427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:55.556078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:28:55.653869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f542-3fae-4a58-8782-381f729c73ff None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.655446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f542-3fae-4a58-8782-381f729c73ff None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.655962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869f542-3fae-4a58-8782-381f729c73ff None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:55.657547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 13/26] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:55.662859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47651c7a-1316-46f2-bafc-6c4afcaa7b5b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.663148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47651c7a-1316-46f2-bafc-6c4afcaa7b5b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.663445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47651c7a-1316-46f2-bafc-6c4afcaa7b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:55.688575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-47651c7a-1316-46f2-bafc-6c4afcaa7b5b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:55.689795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-47651c7a-1316-46f2-bafc-6c4afcaa7b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:55.785323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:28:55.887579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869f542-3fae-4a58-8782-381f729c73ff None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:55.961560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad843-a77f-479b-9af5-79b4a20a5aa6 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.962196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad843-a77f-479b-9af5-79b4a20a5aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.962670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad843-a77f-479b-9af5-79b4a20a5aa6 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:55.964421 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 15/28] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:28:55.973022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70145bdd-28c8-4b3e-b012-de040adbe929 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:55.973656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70145bdd-28c8-4b3e-b012-de040adbe929 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:55.974470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70145bdd-28c8-4b3e-b012-de040adbe929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:56.003016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-70145bdd-28c8-4b3e-b012-de040adbe929 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:56.004277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-70145bdd-28c8-4b3e-b012-de040adbe929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:56.099394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869f542-3fae-4a58-8782-381f729c73ff None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:56.152933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 16/29] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 28 08:28:56.153575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70145bdd-28c8-4b3e-b012-de040adbe929 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:56.161825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:56.162463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:56.162745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:56.163019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:56.196784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:28:56.206021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:28:56.213267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:28:56.221741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 14/30] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:28:56.222961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:56.229399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:56.311022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70145bdd-28c8-4b3e-b012-de040adbe929 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:56.383704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:56.384274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:56.384558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:56.384836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:56.407818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:56.409309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:56.432535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515487ca-2ff2-402a-a478-edebbb30c959 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:28:56.440480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:28:56.442669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:28:56.443705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:28:56.443705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:28:56.443705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:28:56.446198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 17/31] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:28:56.447191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:56.496037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:56.496681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:56.497270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:56.498287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:56.499543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:56.502134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:56.564991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:56.578457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93939a-830a-4673-85d6-6eeb66e0e846 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:56.617737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:56.618416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:56.618704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:56.618988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:56.619757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:28:56.620130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:56.621640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:56.635689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 18/32] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:28:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:28:56.636462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:56.751451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 15/33] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 28 08:28:56 2022] POST /identity/v3/roles => generated 219 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:28:56.751451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:56.758653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949676-0694-4d96-9ab7-26c23ec6131e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:56.841256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:56.841965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:56.842249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:56.842537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:56.843276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:28:56.843620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:56.845040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:56.865452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 19/34] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:28:56.866327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:56.888983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:56.895108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:56.981095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896d1ff-9406-48b3-9f29-47b3ef305cd6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:57.024594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebf57d-3174-44a5-a8f1-296d6676130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:57.025588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebf57d-3174-44a5-a8f1-296d6676130f None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.026090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebf57d-3174-44a5-a8f1-296d6676130f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.026564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebf57d-3174-44a5-a8f1-296d6676130f None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.027458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebf57d-3174-44a5-a8f1-296d6676130f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:57.029797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebf57d-3174-44a5-a8f1-296d6676130f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:57.037872 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152da1c-7de7-438b-a772-05fafff56cad None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:57.076935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:57.077939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.078325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.078695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] PATH_INFO: `/v3/users/b229946b8c534cd194a31028b1b40cec` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.080326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] RBAC: Authorizing `identity:get_user(user_id=b229946b8c534cd194a31028b1b40cec)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:57.081831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:57.083867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 20/35] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:28:56 2022] GET /identity/v3/users/b229946b8c534cd194a31028b1b40cec => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:28:57.084732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:57.104958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 16/36] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 28 08:28:56 2022] POST /identity/v3/roles => generated 225 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:28:57.106315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52d2a-4ac4-46f0-bd61-5c5861325502 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.110234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52d2a-4ac4-46f0-bd61-5c5861325502 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.110234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52d2a-4ac4-46f0-bd61-5c5861325502 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.110234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 17/37] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:57.110234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e52d2a-4ac4-46f0-bd61-5c5861325502 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:57.181317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:57.207064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144869-9a6c-4fee-b205-39f4e151e5de None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:57.224219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e52d2a-4ac4-46f0-bd61-5c5861325502 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:57.247096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebadbd-3ee4-4c57-8eb0-979ae904727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:57.248611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebadbd-3ee4-4c57-8eb0-979ae904727c None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.248901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebadbd-3ee4-4c57-8eb0-979ae904727c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.249185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebadbd-3ee4-4c57-8eb0-979ae904727c None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.249853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebadbd-3ee4-4c57-8eb0-979ae904727c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:57.251712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:57.252587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebadbd-3ee4-4c57-8eb0-979ae904727c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:57.262673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fb02-aff0-48b3-b830-50ef58f77926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:57.264017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fb02-aff0-48b3-b830-50ef58f77926 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.264387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fb02-aff0-48b3-b830-50ef58f77926 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.264935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fb02-aff0-48b3-b830-50ef58f77926 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.266229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fb02-aff0-48b3-b830-50ef58f77926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:57.267756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fb02-aff0-48b3-b830-50ef58f77926 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:57.269390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 18/38] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:28:57.282986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067b4cb-c47a-4215-98e3-3da57bb6c2c8 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.282986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067b4cb-c47a-4215-98e3-3da57bb6c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.282986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067b4cb-c47a-4215-98e3-3da57bb6c2c8 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.282986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 19/39] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:57.282986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0b45c-ad59-4bc6-9819-eadc05773aeb None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.282986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0b45c-ad59-4bc6-9819-eadc05773aeb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.283408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0b45c-ad59-4bc6-9819-eadc05773aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.293074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-58b0b45c-ad59-4bc6-9819-eadc05773aeb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:57.294701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-58b0b45c-ad59-4bc6-9819-eadc05773aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:57.365594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 20/40] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:28:57.366427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0b45c-ad59-4bc6-9819-eadc05773aeb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:57.466175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0b45c-ad59-4bc6-9819-eadc05773aeb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:57.473306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:28:57 2022] POST /identity/v3/projects => generated 301 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:28:57.475373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed5ab-848e-4eea-996b-98e0034556a1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.475830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed5ab-848e-4eea-996b-98e0034556a1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.476231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed5ab-848e-4eea-996b-98e0034556a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.504534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-156ed5ab-848e-4eea-996b-98e0034556a1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:57.506732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-156ed5ab-848e-4eea-996b-98e0034556a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:28:57.592344 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 22/42] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:28:57.603942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:57.617214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:57.618563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.618563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.619006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] PATH_INFO: `/v3/domains/default/users/b229946b8c534cd194a31028b1b40cec/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.621233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b229946b8c534cd194a31028b1b40cec, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:57.622987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:57.646247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed5ab-848e-4eea-996b-98e0034556a1 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:57.714933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:57.736088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 21/43] 10.222.0.57 () {58 vars in 1361 bytes} [Wed Sep 28 08:28:57 2022] PUT /identity/v3/domains/default/users/b229946b8c534cd194a31028b1b40cec/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:28:57.767562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed5ab-848e-4eea-996b-98e0034556a1 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:57.807538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:57.808332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.808622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.808912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.810662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:57.812522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:57.814405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 23/44] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:28:57.820242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:57.870056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:28:57.944959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860306f-7119-499d-a5a9-0664640fbee8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:57.985043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501d399-74e8-4e5b-9935-7b1c8b1fe202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:57.985668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d399-74e8-4e5b-9935-7b1c8b1fe202 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:57.985954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d399-74e8-4e5b-9935-7b1c8b1fe202 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:57.986289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d399-74e8-4e5b-9935-7b1c8b1fe202 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:57.986911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501d399-74e8-4e5b-9935-7b1c8b1fe202 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:57.988450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501d399-74e8-4e5b-9935-7b1c8b1fe202 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:58.095460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:28:57 2022] POST /identity/v3/projects => generated 312 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:28:58.098476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dba3cd-543c-46e8-819c-7531a7ed402c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:28:58.129940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:28:58.138861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0082b8-d438-4193-a38a-a1dd6bd8a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:28:58.144489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0082b8-d438-4193-a38a-a1dd6bd8a51c None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:58.144489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0082b8-d438-4193-a38a-a1dd6bd8a51c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:58.144489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0082b8-d438-4193-a38a-a1dd6bd8a51c None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:58.144489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0082b8-d438-4193-a38a-a1dd6bd8a51c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:28:58.144489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0082b8-d438-4193-a38a-a1dd6bd8a51c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:28:58.288326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 28 08:28:57 2022] POST /identity/v3/roles => generated 223 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:28:59.927158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd748d1-c641-40a2-a6b1-561a352f9f33 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:59.927582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd748d1-c641-40a2-a6b1-561a352f9f33 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:59.927763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd748d1-c641-40a2-a6b1-561a352f9f33 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:59.929107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 23/47] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:28:59.934574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107ff9a-76c2-4a0d-be9e-bdbaae53d27c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:28:59.934987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107ff9a-76c2-4a0d-be9e-bdbaae53d27c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:28:59.935708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107ff9a-76c2-4a0d-be9e-bdbaae53d27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:28:59.953385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8107ff9a-76c2-4a0d-be9e-bdbaae53d27c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:28:59.954559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8107ff9a-76c2-4a0d-be9e-bdbaae53d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:00.018484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:00.258672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078baee6-4642-4b2f-a9eb-3eb2121a1f65 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.258963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078baee6-4642-4b2f-a9eb-3eb2121a1f65 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.259243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078baee6-4642-4b2f-a9eb-3eb2121a1f65 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.260662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 24/49] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:00.266783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cfc5-a86e-41e8-8947-0c5ebeed26cc None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.267075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cfc5-a86e-41e8-8947-0c5ebeed26cc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.267355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897cfc5-a86e-41e8-8947-0c5ebeed26cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.285011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1897cfc5-a86e-41e8-8947-0c5ebeed26cc None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:00.286268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1897cfc5-a86e-41e8-8947-0c5ebeed26cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:00.286396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078baee6-4642-4b2f-a9eb-3eb2121a1f65 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:00.322307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:00.356230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 26/50] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:00.390014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078baee6-4642-4b2f-a9eb-3eb2121a1f65 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:00.422181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:00.422798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.423079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.423349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.433077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:00.438884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:00.439963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:00.440761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 25/51] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:00.445891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cfc5-a86e-41e8-8947-0c5ebeed26cc None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:00.497274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:00.547914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897cfc5-a86e-41e8-8947-0c5ebeed26cc None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:00.579903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:00.580506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.580789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.581060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.581716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:00.582016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:00.583381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:00.591814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 27/52] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:00.597334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:00.638060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:00.692536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:00.699082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c1fe-1d5c-4c55-9f77-32f83741a4c3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:00.732719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:00.734225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.734703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.735020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] PATH_INFO: `/v3/users/b229946b8c534cd194a31028b1b40cec` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.736564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] RBAC: Authorizing `identity:get_user(user_id=b229946b8c534cd194a31028b1b40cec)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:00.738033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:00.738935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173e1f7-b29b-49f3-9f4b-1babbf98248c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:00.739635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:00 2022] GET /identity/v3/users/b229946b8c534cd194a31028b1b40cec => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:00.745056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:00.749904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:00.773234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:00.773867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.774147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.774418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.775563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:00.776993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:00.779017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 28/54] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:00.784876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:00.845301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77163fb3-b7b2-4676-bf23-0272569c3922 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:00.879627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:00.881759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.881759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.881759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.881992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:00.883339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:00.884114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a56a6a-1833-4625-b675-3c7d85cc35f2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:00.884934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:00.891111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:00.918950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c509-e645-425a-bbc0-3b159524e194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:00.919605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c509-e645-425a-bbc0-3b159524e194 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:00.919961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c509-e645-425a-bbc0-3b159524e194 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:00.920186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c509-e645-425a-bbc0-3b159524e194 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:00.921479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c509-e645-425a-bbc0-3b159524e194 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:00.923036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c509-e645-425a-bbc0-3b159524e194 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:00.923457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:00.991678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ebca8-4f98-4642-bbb4-dca9d8078670 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:01.024340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d306bb-31ba-465d-9526-d0cf8f02cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:01.024935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d306bb-31ba-465d-9526-d0cf8f02cb63 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:01.027890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d306bb-31ba-465d-9526-d0cf8f02cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:01.027890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d306bb-31ba-465d-9526-d0cf8f02cb63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:01.027890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d306bb-31ba-465d-9526-d0cf8f02cb63 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.domain.id=default, user.id=b229946b8c534cd194a31028b1b40cec) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:01.027890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d306bb-31ba-465d-9526-d0cf8f02cb63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:01.028280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d306bb-31ba-465d-9526-d0cf8f02cb63 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:01.033929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1322 bytes} [Wed Sep 28 08:29:00 2022] GET /identity/v3/role_assignments?user.id=b229946b8c534cd194a31028b1b40cec&scope.domain.id=default&role.id=8b22e1c1112547309cda07f916d1a452 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:01.055112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 29/57] 10.222.0.57 () {60 vars in 1140 bytes} [Wed Sep 28 08:29:00 2022] POST /identity/v3/projects => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:29:03.210669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db7d1-ffbf-42f0-a61b-493e24a1725a None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:03.211174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db7d1-ffbf-42f0-a61b-493e24a1725a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:03.211174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db7d1-ffbf-42f0-a61b-493e24a1725a None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:03.212531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 29/58] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:03.218238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c0e2-65f2-41d6-9be7-99da02874cd3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:03.218798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c0e2-65f2-41d6-9be7-99da02874cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:03.218798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47c0e2-65f2-41d6-9be7-99da02874cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:03.236797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8e47c0e2-65f2-41d6-9be7-99da02874cd3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:03.237977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8e47c0e2-65f2-41d6-9be7-99da02874cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:03.261602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:03.304844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 30/59] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:03.570829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162db7d1-ffbf-42f0-a61b-493e24a1725a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:03.662740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:03.669924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162db7d1-ffbf-42f0-a61b-493e24a1725a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:03.703006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052be29-10e3-4f2c-a606-2a2aa365928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:03.703833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052be29-10e3-4f2c-a606-2a2aa365928a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:03.704277 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052be29-10e3-4f2c-a606-2a2aa365928a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:03.704866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052be29-10e3-4f2c-a606-2a2aa365928a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:03.705972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052be29-10e3-4f2c-a606-2a2aa365928a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:03.707437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052be29-10e3-4f2c-a606-2a2aa365928a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:03.708992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:03.714701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47c0e2-65f2-41d6-9be7-99da02874cd3 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:03.815625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47c0e2-65f2-41d6-9be7-99da02874cd3 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:03.849352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba24b9-d1bf-4e5a-a85a-fc4bb3bea868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:03.849908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba24b9-d1bf-4e5a-a85a-fc4bb3bea868 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:03.850195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba24b9-d1bf-4e5a-a85a-fc4bb3bea868 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:03.850473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba24b9-d1bf-4e5a-a85a-fc4bb3bea868 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:03.851132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba24b9-d1bf-4e5a-a85a-fc4bb3bea868 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:03.852601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba24b9-d1bf-4e5a-a85a-fc4bb3bea868 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:03.949265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:29:03 2022] POST /identity/v3/users => generated 275 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:07.230010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef274d9-7557-4ad6-a275-e721ff9cef72 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.230496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef274d9-7557-4ad6-a275-e721ff9cef72 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.230496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef274d9-7557-4ad6-a275-e721ff9cef72 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.232073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 31/62] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:07.253579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b601bb5-5177-460c-beaa-7bce78455f91 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.254613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b601bb5-5177-460c-beaa-7bce78455f91 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.255089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b601bb5-5177-460c-beaa-7bce78455f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.292423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6b601bb5-5177-460c-beaa-7bce78455f91 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:07.293980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6b601bb5-5177-460c-beaa-7bce78455f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:07.306306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:07.380648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 32/63] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:07.380953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e3918-3688-4b77-976d-564a79f2df75 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.381241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e3918-3688-4b77-976d-564a79f2df75 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.381525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e3918-3688-4b77-976d-564a79f2df75 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.383083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 32/64] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:07.396181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3e1a-8afe-4799-9fd0-cbd178c7ab3c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.396477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3e1a-8afe-4799-9fd0-cbd178c7ab3c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.396760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d3e1a-8afe-4799-9fd0-cbd178c7ab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.433868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6c3d3e1a-8afe-4799-9fd0-cbd178c7ab3c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:07.435083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6c3d3e1a-8afe-4799-9fd0-cbd178c7ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:07.533075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 33/65] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:07.611335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599530-84b4-4689-9caa-1ca0548bf8ba None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.611666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599530-84b4-4689-9caa-1ca0548bf8ba None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.611923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5599530-84b4-4689-9caa-1ca0548bf8ba None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.613389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 33/66] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:07.619357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd88b-592a-4b1c-bdd7-08df90a13bf0 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.620058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd88b-592a-4b1c-bdd7-08df90a13bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.620538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd88b-592a-4b1c-bdd7-08df90a13bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.643241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0f6cd88b-592a-4b1c-bdd7-08df90a13bf0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:07.644838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0f6cd88b-592a-4b1c-bdd7-08df90a13bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:07.719083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 34/67] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:07.724796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5599530-84b4-4689-9caa-1ca0548bf8ba None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:07.814462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c072ad-276b-4c1d-8923-381ab088566b None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.815067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c072ad-276b-4c1d-8923-381ab088566b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.815597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c072ad-276b-4c1d-8923-381ab088566b None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.817154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 35/68] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:29:07.828665 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179b73-6ef8-4852-91da-a4cfaae42e0d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.829233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179b73-6ef8-4852-91da-a4cfaae42e0d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.829707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179b73-6ef8-4852-91da-a4cfaae42e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.860289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:07.867414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-67179b73-6ef8-4852-91da-a4cfaae42e0d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:07.868630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-67179b73-6ef8-4852-91da-a4cfaae42e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:07.910287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5599530-84b4-4689-9caa-1ca0548bf8ba None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:07.971622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:07.972526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:07.972821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:07.973096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:07.987744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 36/69] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 28 08:29:07.988040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:07.989185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67179b73-6ef8-4852-91da-a4cfaae42e0d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:07.994487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:07.995728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:07.996603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 34/70] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:08.004494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.053415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.125869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67179b73-6ef8-4852-91da-a4cfaae42e0d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.151545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37149723-42fe-4d60-a550-d17c22f19760 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.164094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.164732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.165019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.165297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.169136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.177946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:08.185268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:08.186153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:08.187128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 37/71] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:08.187832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.195112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c23585-6e9b-4e93-9ec6-0902003ef603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.195759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23585-6e9b-4e93-9ec6-0902003ef603 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.196036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23585-6e9b-4e93-9ec6-0902003ef603 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.196314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c23585-6e9b-4e93-9ec6-0902003ef603 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.196980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c23585-6e9b-4e93-9ec6-0902003ef603 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:08.197284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c23585-6e9b-4e93-9ec6-0902003ef603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:08.198658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c23585-6e9b-4e93-9ec6-0902003ef603 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:08.212630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 35/72] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:08.212630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afab99d-e142-4618-97ce-6c0599deaf60 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.212630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afab99d-e142-4618-97ce-6c0599deaf60 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.212630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afab99d-e142-4618-97ce-6c0599deaf60 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.212630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 36/73] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:08.212630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afab99d-e142-4618-97ce-6c0599deaf60 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.298301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.306529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c43197-fa78-437c-b638-411977a68ee1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.314359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afab99d-e142-4618-97ce-6c0599deaf60 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.341175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.341802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.342085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.342933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.348067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d3283-0ab5-4e86-a946-a3553d59cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.348673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d3283-0ab5-4e86-a946-a3553d59cb6b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.348958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d3283-0ab5-4e86-a946-a3553d59cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.349238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d3283-0ab5-4e86-a946-a3553d59cb6b None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.349907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d3283-0ab5-4e86-a946-a3553d59cb6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:08.350242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d3283-0ab5-4e86-a946-a3553d59cb6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:08.351646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d3283-0ab5-4e86-a946-a3553d59cb6b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:08.352805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:08.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:08.359110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:08.359939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 38/74] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:08.360593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.360657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:08.361744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87243896-e8ae-4d1d-b74f-51c38ee2896d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.362039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87243896-e8ae-4d1d-b74f-51c38ee2896d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.362318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87243896-e8ae-4d1d-b74f-51c38ee2896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.380211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-87243896-e8ae-4d1d-b74f-51c38ee2896d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:08.381353 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-87243896-e8ae-4d1d-b74f-51c38ee2896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:08.419967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.447126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 38/76] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:08.456349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87243896-e8ae-4d1d-b74f-51c38ee2896d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.463799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cc434-a28b-4b11-87e7-b8ad2165ba9b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.500629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.501264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.501550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.501830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.518127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:08.519658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:08.525602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 39/77] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:08.525602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.547596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.571621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87243896-e8ae-4d1d-b74f-51c38ee2896d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.608306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.609388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.609679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.609952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.620586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:08.625594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:08.626445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:08.627241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 39/78] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:08.627924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.633932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6544cb3-6c26-4f1c-ab92-942fb35a0cde None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.650270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.671847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.672453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.672739 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.673013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.673669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:08.673971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:08.675492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:08.688885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 40/79] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:08.688885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.738008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3826564-0806-4683-94b5-130711bdf132 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.772242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.772874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.773165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.773443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] PATH_INFO: `/v3/users/b229946b8c534cd194a31028b1b40cec` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.774590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] RBAC: Authorizing `identity:get_user(user_id=b229946b8c534cd194a31028b1b40cec)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:08.776093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:08.777821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 40/80] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/users/b229946b8c534cd194a31028b1b40cec => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:08.778503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.783067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.793607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f403aa0-ff7f-4e0e-976c-2162727d6175 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.828070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.828679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.828962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.829238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.873733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:08.876975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb2b7-942d-4222-b942-4c6a474707b1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:08.896318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:08.897787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:08.914057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:08.914686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:08.914975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:08.915258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:08.918350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:08.918670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:08.920092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:08.929361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 41/81] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:08.930489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:08.993975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.000368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 41/82] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:09.001213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.032145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e80de-b879-442b-8421-9e86ea19208e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.065312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.065930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.066211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.066482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.067625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.069059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.070603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 42/83] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:08 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:09.071357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.084538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.106108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6cd3-54dd-4efb-ad87-da12eaa0e4f3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.141702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.142334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.142616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.142888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.144012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.145451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.147162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 42/84] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:09.147894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.170194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51d045-258f-4195-96ed-a4deeceb9fd0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.204006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.204608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.204889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.205165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.207717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.243820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6a0e-bc9b-456d-97d8-ba1a83a90811 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.274095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.275660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.281954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.282600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.282888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.283170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.284341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.285779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.287548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 43/85] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:09.288145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.303059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.377595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 43/86] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:09.378530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.391975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d23e3-1608-4e82-a67c-c840f355e07b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.410873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.425631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.426264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.426546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.426833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.427963 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.429443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.431038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 44/87] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:09.431808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.479802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d832be-95a3-4ac5-8e81-a80d0b0c07a4 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.510681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.514749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.515387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.515698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.520744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.529004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ad7fa-c3f2-4848-9c9d-3cc34b9e824c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.564133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.564842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.565211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.565497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.566152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.567626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.582805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.584305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.616124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.658437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 45/88] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:29:09 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:09.659273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.683805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 44/89] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:09.684612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.799024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65a9f1-72c7-4150-b11b-f24fd1b79b99 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.799229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45abecf-bf9b-4ea9-9a78-5b803fe6b749 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:09.837626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.837820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:09.838269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.838390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:09.838601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.838692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:09.838881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.838979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:09.840078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.841748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.843015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.844854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 45/90] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:09.845648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:09.853564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:09.926850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:09.928029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:09.979705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76457391-95b3-48cb-b4ce-9ebd11c993db None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:10.022024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:10.022676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:10.022964 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:10.023246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:10.024452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=7c7828409b6d44438fbb82bf8a9c104d) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:10.024828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:10.027022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:10.033589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 46/91] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/role_assignments?user.id=7c7828409b6d44438fbb82bf8a9c104d&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:10.034446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:10.056943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 46/92] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:10.058268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:10.104434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:10.116913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:10.160239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004514b1-26f0-401b-8751-b4e7d1a7f04b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:10.207024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:10.209826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:10.210292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:10.210707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:10.213497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:10.216783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:10.220263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 47/93] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:10 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:10.225000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:10.259971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ad0ad-b7fa-4e10-8650-67ac60a8eaaa None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:10.332166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:10.333021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:10.333442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:10.333877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:10.334750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=b229946b8c534cd194a31028b1b40cec) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:10.335198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:10.336800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:10.351548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 47/94] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:10 2022] GET /identity/v3/role_assignments?user.id=b229946b8c534cd194a31028b1b40cec&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:10.358374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:10.445486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc39f23-bae4-43d4-bc39-974da39dfdbc None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:10.524020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:10.524875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:10.525280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:10.525693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] PATH_INFO: `/v3/projects/b79f464c53e64ebaa9eb0425295d9f45` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:10.532376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] RBAC: Authorizing `identity:get_project(project_id=b79f464c53e64ebaa9eb0425295d9f45)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:10.534130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:10.536393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 48/95] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:10 2022] GET /identity/v3/projects/b79f464c53e64ebaa9eb0425295d9f45 => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:10.541970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:10.550171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:10.580488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:10.584485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c82a49-191a-4318-87c5-100cf2c271f3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:10.684888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5cca2-85ec-47e5-aca2-978123766d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:10.685541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cca2-85ec-47e5-aca2-978123766d42 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:10.685835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cca2-85ec-47e5-aca2-978123766d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:10.686157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5cca2-85ec-47e5-aca2-978123766d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:10.687610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5cca2-85ec-47e5-aca2-978123766d42 None admin] RBAC: Adding query filter params (role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=7c7828409b6d44438fbb82bf8a9c104d) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:10.687935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5cca2-85ec-47e5-aca2-978123766d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:10.689383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5cca2-85ec-47e5-aca2-978123766d42 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:10.703760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 48/96] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:10 2022] GET /identity/v3/role_assignments?user.id=7c7828409b6d44438fbb82bf8a9c104d&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:10.724169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d3aa4-189e-4445-8368-1c37b2dfa511 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:10.791342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef51e56-2aa3-4da7-8333-ae565d3e41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:10.791937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef51e56-2aa3-4da7-8333-ae565d3e41a2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:10.792222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef51e56-2aa3-4da7-8333-ae565d3e41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:10.792498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef51e56-2aa3-4da7-8333-ae565d3e41a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:10.793281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef51e56-2aa3-4da7-8333-ae565d3e41a2 None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=b79f464c53e64ebaa9eb0425295d9f45, user.id=7c7828409b6d44438fbb82bf8a9c104d) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:10.793599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef51e56-2aa3-4da7-8333-ae565d3e41a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:10.795194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef51e56-2aa3-4da7-8333-ae565d3e41a2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:10.808530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 49/97] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:10 2022] GET /identity/v3/role_assignments?user.id=7c7828409b6d44438fbb82bf8a9c104d&scope.project.id=b79f464c53e64ebaa9eb0425295d9f45&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:12.635362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ddb8-9c84-4d2f-b3a8-48a417c20f44 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:12.635928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ddb8-9c84-4d2f-b3a8-48a417c20f44 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:12.635928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ddb8-9c84-4d2f-b3a8-48a417c20f44 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:12.637562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 49/98] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:12.643050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ecc4-8c50-41b8-8b6a-e8ce6888b144 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:12.643470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ecc4-8c50-41b8-8b6a-e8ce6888b144 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:12.643655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ecc4-8c50-41b8-8b6a-e8ce6888b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:12.656017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e5c93-4e8e-4782-9f8a-4fc1842b9633 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:12.656619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e5c93-4e8e-4782-9f8a-4fc1842b9633 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:12.657089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e5c93-4e8e-4782-9f8a-4fc1842b9633 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:12.658622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 50/99] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:12.663128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ce03ecc4-8c50-41b8-8b6a-e8ce6888b144 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:12.664122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963bfd4-acb8-47e2-b0d9-2e2a344b2925 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:12.664626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963bfd4-acb8-47e2-b0d9-2e2a344b2925 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:12.665089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963bfd4-acb8-47e2-b0d9-2e2a344b2925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:12.668490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ce03ecc4-8c50-41b8-8b6a-e8ce6888b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:12.686032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0963bfd4-acb8-47e2-b0d9-2e2a344b2925 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:12.687570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0963bfd4-acb8-47e2-b0d9-2e2a344b2925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:12.783678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:12.797759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 50/100] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:12.798900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 51/101] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:13.226699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243555-5cc8-4466-bffd-164d5fa78e6f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.227077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243555-5cc8-4466-bffd-164d5fa78e6f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.227193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243555-5cc8-4466-bffd-164d5fa78e6f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.228764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 51/102] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:13.234108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d29207-1737-4f71-b1d2-1cb43dae0a25 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.234400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d29207-1737-4f71-b1d2-1cb43dae0a25 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.234685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d29207-1737-4f71-b1d2-1cb43dae0a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.257646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-57d29207-1737-4f71-b1d2-1cb43dae0a25 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:13.258825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-57d29207-1737-4f71-b1d2-1cb43dae0a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:13.267737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c243555-5cc8-4466-bffd-164d5fa78e6f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:13.374141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 52/103] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:13.375325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d29207-1737-4f71-b1d2-1cb43dae0a25 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:13.414433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:13.508304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c243555-5cc8-4466-bffd-164d5fa78e6f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:13.538662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d29207-1737-4f71-b1d2-1cb43dae0a25 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:13.576825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:13.577890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.578389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.578852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.581989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:13.582535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.582828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.583108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.591019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:13.598307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:13.599194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:13.599994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:13.602557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 53/104] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:13.608996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:13.612045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:13.617243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:13.618102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:13.618856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 52/105] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:13.625314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:13.719809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:13.733667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c50cf2-d021-4eea-a9f6-1c7892f57ac9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:13.767992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:13.771897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4bf83-a77f-4760-8add-9ae390c952c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:13.772746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bf83-a77f-4760-8add-9ae390c952c2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.773237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bf83-a77f-4760-8add-9ae390c952c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.773697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bf83-a77f-4760-8add-9ae390c952c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.774550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4bf83-a77f-4760-8add-9ae390c952c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:13.775041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4bf83-a77f-4760-8add-9ae390c952c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:13.776660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4bf83-a77f-4760-8add-9ae390c952c2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:13.786223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 54/106] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:13.787972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138641eb-9c48-43b3-8cc5-e13141cb56c3 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.788460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138641eb-9c48-43b3-8cc5-e13141cb56c3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.788945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138641eb-9c48-43b3-8cc5-e13141cb56c3 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.790479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 55/107] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:13.797108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890535-ab6d-43e6-a16a-410ae66907e4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.797684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890535-ab6d-43e6-a16a-410ae66907e4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.798159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb890535-ab6d-43e6-a16a-410ae66907e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.819444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-cb890535-ab6d-43e6-a16a-410ae66907e4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:13.821027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cb890535-ab6d-43e6-a16a-410ae66907e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:13.875400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b771b7-51aa-42f2-bab6-b37af05fc2d7 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:13.902189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 56/108] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:13.903951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890535-ab6d-43e6-a16a-410ae66907e4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:13.919821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:13.923200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:13.923200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:13.923200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:13.923200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:13.923200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:13.924420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:13.933809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 53/109] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:13.934636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.014593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:14.046982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb890535-ab6d-43e6-a16a-410ae66907e4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.059278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc377c3-b2fb-4c90-8219-c0a0c5074092 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.079557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:14.092938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c05ca-5983-4d6a-97a6-45d8a30a67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.093759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c05ca-5983-4d6a-97a6-45d8a30a67fc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.094098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c05ca-5983-4d6a-97a6-45d8a30a67fc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.094441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c05ca-5983-4d6a-97a6-45d8a30a67fc None admin] PATH_INFO: `/v3/users/e0f3679c15be47799407fc79701aa756` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.101229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.102257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.102690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.103113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.104573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:14.106304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:14.109286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 54/110] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:14.114020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.114157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c05ca-5983-4d6a-97a6-45d8a30a67fc None admin] RBAC: Authorizing `identity:get_user(user_id=e0f3679c15be47799407fc79701aa756)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:14.114157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c05ca-5983-4d6a-97a6-45d8a30a67fc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:14.114157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 57/111] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:13 2022] GET /identity/v3/users/e0f3679c15be47799407fc79701aa756 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:14.117277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4201ff3-6a82-4625-84dd-63892d8998c0 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.117277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4201ff3-6a82-4625-84dd-63892d8998c0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.117277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4201ff3-6a82-4625-84dd-63892d8998c0 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.117494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 58/112] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:14.121572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4201ff3-6a82-4625-84dd-63892d8998c0 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.239002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed91659-49bb-4ac3-8a8f-02d1afdc6d5c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.259397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4201ff3-6a82-4625-84dd-63892d8998c0 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.282318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.282949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.283229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.283533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.284660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:14.286126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:14.287730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 55/113] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:14 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:14.288461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.298603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ee8da-5b58-4814-b0fd-589989024ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.299149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ee8da-5b58-4814-b0fd-589989024ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.299529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ee8da-5b58-4814-b0fd-589989024ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.299816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ee8da-5b58-4814-b0fd-589989024ad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.302415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:14.346729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:14.368210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ee8da-5b58-4814-b0fd-589989024ad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:14.369706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ee8da-5b58-4814-b0fd-589989024ad6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:14.391503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ffc89-61b5-403b-9133-bd27fed1eb8a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.422951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaf2f8-4b90-47d1-9d54-7f78878397c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.423583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaf2f8-4b90-47d1-9d54-7f78878397c7 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.423862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaf2f8-4b90-47d1-9d54-7f78878397c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.424133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaf2f8-4b90-47d1-9d54-7f78878397c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.424772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaf2f8-4b90-47d1-9d54-7f78878397c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:14.426194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaf2f8-4b90-47d1-9d54-7f78878397c7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:14.466206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 59/114] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:14.467540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd196d-c883-453d-ad41-13c712e96021 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.467794 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd196d-c883-453d-ad41-13c712e96021 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.468055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd196d-c883-453d-ad41-13c712e96021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.484882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b2dd196d-c883-453d-ad41-13c712e96021 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:14.486053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b2dd196d-c883-453d-ad41-13c712e96021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:14.511799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:14.517324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 56/115] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:29:14 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:14.518571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a290f-ff77-4015-9648-35b4c5eddfa5 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.518859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a290f-ff77-4015-9648-35b4c5eddfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.519193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a290f-ff77-4015-9648-35b4c5eddfa5 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.520391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 57/116] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:14.524659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a290f-ff77-4015-9648-35b4c5eddfa5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.565922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 60/117] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:14.566522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd196d-c883-453d-ad41-13c712e96021 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.656488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a290f-ff77-4015-9648-35b4c5eddfa5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.665145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:14.702622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.703826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.704113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.704390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.716198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:14.721149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:14.722007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:14.722779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 58/118] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:14.723410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.732182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd196d-c883-453d-ad41-13c712e96021 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.829671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccd059-975d-44b8-931b-c726aa5015f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.830596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd059-975d-44b8-931b-c726aa5015f2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.831054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd059-975d-44b8-931b-c726aa5015f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.831530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd059-975d-44b8-931b-c726aa5015f2 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.833034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccd059-975d-44b8-931b-c726aa5015f2 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:14.834663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccd059-975d-44b8-931b-c726aa5015f2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:14.836800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 61/119] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:14 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:14.838125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11db8b-ab7c-436d-a755-88bb34aed951 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.838712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11db8b-ab7c-436d-a755-88bb34aed951 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.839142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11db8b-ab7c-436d-a755-88bb34aed951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.859051 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ef11db8b-ab7c-436d-a755-88bb34aed951 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:14.860275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ef11db8b-ab7c-436d-a755-88bb34aed951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:14.888631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:14.903802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e9c17-9f05-4718-be8b-9e2a1c6ecc67 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:14.938235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 62/120] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:14.939396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11db8b-ab7c-436d-a755-88bb34aed951 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:14.953796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:14.954556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:14.954843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:14.955121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:14.956315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:14.957913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:14.959691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 59/121] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:14 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:14.960500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.012387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:15.069512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11db8b-ab7c-436d-a755-88bb34aed951 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.094615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5797751-dbe0-49bc-9166-e41df793d110 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.113845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.114473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.114764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.115054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.116052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:15.116395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:15.118205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:15.129293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 63/122] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:15.131048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.147445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.148174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.148906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.149199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49/users/7c7828409b6d44438fbb82bf8a9c104d/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.151781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] RBAC: Authorizing `identity:create_grant(project_id=863360da8758425aa2e288263bd6db49, user_id=7c7828409b6d44438fbb82bf8a9c104d, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:15.154126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:15.163950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:15.223451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 60/123] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:14 2022] PUT /identity/v3/projects/863360da8758425aa2e288263bd6db49/users/7c7828409b6d44438fbb82bf8a9c104d/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:15.223451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.256858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2581f9-a0c2-443d-94df-e9538873081e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.300633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.301397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.301688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.301998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.314979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:15.320698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:15.321613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:15.322376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 64/124] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:15.323005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.353580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:15.365082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6eca-9e1f-4827-acfc-18863df0c86c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.413192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.413919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.414217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.414496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.415294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] RBAC: Adding query filter params (role.id=81df27a3458948d98f5562812ed7280e, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=e0f3679c15be47799407fc79701aa756) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:15.415638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:15.417351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:15.423982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 61/125] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/role_assignments?user.id=e0f3679c15be47799407fc79701aa756&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=81df27a3458948d98f5562812ed7280e => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:15.424656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.439833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:15.460783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a819961-bdfb-4082-8577-db4dd892a677 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.515540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.516192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.516476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.516754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] PATH_INFO: `/v3/users/b229946b8c534cd194a31028b1b40cec` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.517899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] RBAC: Authorizing `identity:get_user(user_id=b229946b8c534cd194a31028b1b40cec)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:15.519939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:15.522497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 65/126] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/users/b229946b8c534cd194a31028b1b40cec => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:15.523523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.555724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaeb67-9aa1-43bb-b154-2a8a6bc2de8a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.620646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.621210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.621490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.621761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.651151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:15.661332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:15.662274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:15.663051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 62/127] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:15.667326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.684221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee783903-f2e2-4e00-927d-c0eb4be6163b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.718615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:15.721583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.722198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.722521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.722800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.723509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:15.723818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:15.725970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:15.735514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 66/128] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:15.736230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.775825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:15.846198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312bec8-bbda-4361-b60a-ec357139df44 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.904404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.905479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.905769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.906052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:15.906733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:15.907043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:15.908471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:15.927358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 67/129] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:15.928142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:15.929354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298095-bd14-4a58-807e-e1d08049394a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:15.993741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:15.995880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:15.996172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:15.996557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.000108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.001713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.003500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 63/130] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:16.004365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:16.055863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:16.073535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90d827-e50b-43ed-9191-f343ad747311 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:16.149331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:16.163515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:16.163515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:16.163515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:16.163515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.163857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.163857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.165079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 68/131] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:15 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:16.165834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:16.174788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27fff8-b70f-47e2-9c76-be37779fafbd None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:16.235032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:16.235702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:16.235988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:16.236267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.240466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.241935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.245865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 64/132] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:16 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:16.246428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:16.332576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5226632-002c-42fb-a7ad-b4fcd7d39577 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:16.408663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:16.409341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:16.409627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:16.409909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49/users/b229946b8c534cd194a31028b1b40cec/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.413464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=863360da8758425aa2e288263bd6db49, user_id=b229946b8c534cd194a31028b1b40cec, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.414966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.428160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9ed3e-235d-4922-a419-61113e373fbb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:16.465134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:16.465773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:16.466057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:16.466339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] PATH_INFO: `/v3/projects/b79f464c53e64ebaa9eb0425295d9f45` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.467840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] RBAC: Authorizing `identity:get_project(project_id=b79f464c53e64ebaa9eb0425295d9f45)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.469475 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.471285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 65/133] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:16 2022] GET /identity/v3/projects/b79f464c53e64ebaa9eb0425295d9f45 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:16.471903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:16.493490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 69/134] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:16 2022] PUT /identity/v3/projects/863360da8758425aa2e288263bd6db49/users/b229946b8c534cd194a31028b1b40cec/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:16.494180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:16.499781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:16.516738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:16.631365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c1abc-74ae-4ad4-a55e-9b9123e9127a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:16.702321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:16.703051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:16.703340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:16.703643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.704841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.706321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.713589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 66/135] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:16 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:16.719692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:16.743837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbc39d-d2cc-4bab-80f3-731de247bff9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:16.787581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f43d3-fc94-4865-a101-9cef2ecb5c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:16.788407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f43d3-fc94-4865-a101-9cef2ecb5c9c None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:16.788705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f43d3-fc94-4865-a101-9cef2ecb5c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:16.788987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f43d3-fc94-4865-a101-9cef2ecb5c9c None admin] PATH_INFO: `/v3/projects/b79f464c53e64ebaa9eb0425295d9f45/users/7c7828409b6d44438fbb82bf8a9c104d/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.791178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f43d3-fc94-4865-a101-9cef2ecb5c9c None admin] RBAC: Authorizing `identity:create_grant(project_id=b79f464c53e64ebaa9eb0425295d9f45, user_id=7c7828409b6d44438fbb82bf8a9c104d, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.792701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f43d3-fc94-4865-a101-9cef2ecb5c9c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.837752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:16.847953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b2157-ecbc-41d6-8170-9eb68ac9f5d4 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:16.863574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 70/136] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:16 2022] PUT /identity/v3/projects/b79f464c53e64ebaa9eb0425295d9f45/users/7c7828409b6d44438fbb82bf8a9c104d/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:16.887976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1203a-f223-41d1-9d11-8967bf7121f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:16.888688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1203a-f223-41d1-9d11-8967bf7121f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:16.889261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1203a-f223-41d1-9d11-8967bf7121f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:16.889538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1203a-f223-41d1-9d11-8967bf7121f5 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49/users/7c7828409b6d44438fbb82bf8a9c104d/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:16.892420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1203a-f223-41d1-9d11-8967bf7121f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=863360da8758425aa2e288263bd6db49, user_id=7c7828409b6d44438fbb82bf8a9c104d, role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:16.893935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1203a-f223-41d1-9d11-8967bf7121f5 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:16.985255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 67/137] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:16 2022] PUT /identity/v3/projects/863360da8758425aa2e288263bd6db49/users/7c7828409b6d44438fbb82bf8a9c104d/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:29:17.127206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d727a-0860-491b-a176-de70293a7106 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:17.127544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d727a-0860-491b-a176-de70293a7106 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:17.127796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d727a-0860-491b-a176-de70293a7106 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:17.129318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 71/138] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:17.141888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b566-98bb-4126-9499-c5efe051510a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:17.142194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b566-98bb-4126-9499-c5efe051510a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:17.142443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041b566-98bb-4126-9499-c5efe051510a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:17.168812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4041b566-98bb-4126-9499-c5efe051510a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:17.170263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4041b566-98bb-4126-9499-c5efe051510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:17.258555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 68/139] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:17.637405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d727a-0860-491b-a176-de70293a7106 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:17.717650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:17.765854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d727a-0860-491b-a176-de70293a7106 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:17.809019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6854c-2997-445b-93ce-2ba660594e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:17.809669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6854c-2997-445b-93ce-2ba660594e20 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:17.809961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6854c-2997-445b-93ce-2ba660594e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:17.810243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6854c-2997-445b-93ce-2ba660594e20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:17.812144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6854c-2997-445b-93ce-2ba660594e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:17.813760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6854c-2997-445b-93ce-2ba660594e20 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:17.815519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 72/140] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:17.821144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041b566-98bb-4126-9499-c5efe051510a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:17.920172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:17.943175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041b566-98bb-4126-9499-c5efe051510a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:17.983866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca0e98-1462-4226-badf-139bc6ca121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:17.985032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca0e98-1462-4226-badf-139bc6ca121c None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:17.985321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca0e98-1462-4226-badf-139bc6ca121c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:17.985842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca0e98-1462-4226-badf-139bc6ca121c None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:17.986275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca0e98-1462-4226-badf-139bc6ca121c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:17.988023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca0e98-1462-4226-badf-139bc6ca121c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:18.087472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 69/141] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:29:17 2022] POST /identity/v3/users => generated 283 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:18.113184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15c96f-b41b-4698-a8c5-8f77cb4c450f None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:18.113806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15c96f-b41b-4698-a8c5-8f77cb4c450f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:18.114292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15c96f-b41b-4698-a8c5-8f77cb4c450f None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:18.115964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 73/142] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:18.133617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bef09-c489-48e7-9dec-64fa66deb90f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:18.133939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bef09-c489-48e7-9dec-64fa66deb90f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:18.134383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bef09-c489-48e7-9dec-64fa66deb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:18.160783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ab6bef09-c489-48e7-9dec-64fa66deb90f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:18.162133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ab6bef09-c489-48e7-9dec-64fa66deb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:18.249804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 70/143] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:18.468345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284e8e3-852d-4ea7-bd7d-bd1cff72c26f None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:18.469012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284e8e3-852d-4ea7-bd7d-bd1cff72c26f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:18.469490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284e8e3-852d-4ea7-bd7d-bd1cff72c26f None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:18.471026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 74/144] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:18.476544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f78b70-cc48-44f6-a6fd-dbbb7301328a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:18.477149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f78b70-cc48-44f6-a6fd-dbbb7301328a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:18.477627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f78b70-cc48-44f6-a6fd-dbbb7301328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:18.497900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f1f78b70-cc48-44f6-a6fd-dbbb7301328a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:18.500192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f1f78b70-cc48-44f6-a6fd-dbbb7301328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:18.565603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284e8e3-852d-4ea7-bd7d-bd1cff72c26f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:18.567288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:18.578834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 71/145] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:18.677464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284e8e3-852d-4ea7-bd7d-bd1cff72c26f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:18.711548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:18.717893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:18.718777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:18.719241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:18.719713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:18.730360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:18.736099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:18.742802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:18.743641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 75/146] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:18.744315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f78b70-cc48-44f6-a6fd-dbbb7301328a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:18.891408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f78b70-cc48-44f6-a6fd-dbbb7301328a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:18.941986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:18.942610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:18.942890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:18.943164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:18.943888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:18.944194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:18.945589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:18.959311 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 72/147] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:18.964973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:18.985257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:19.093391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d6dde-1980-4bc9-ac92-1c25b3f61f8a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:19.097272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:19.132540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:19.133577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.134063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.134539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.135938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:19.137591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:19.140338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 76/148] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:18 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:19.146338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:19.189373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18732bc0-9f6a-4ffc-bbfb-3fc212ceef63 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:19.213931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:19.229869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:19.230734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.231226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.232664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.244029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:19.249666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:19.250558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:19.251329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:19.253646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 73/149] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:19.266734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56d76c-c9d8-4dd4-a141-de6b28b93fe1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:19.273618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:19.306331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:19.306984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.307267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.307571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.383611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:19.385090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:19.451983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:19.482131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c974f-72f9-4dcd-bb7a-3751f080fe65 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:19.495604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 77/150] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:29:19.502119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:19.520621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:19.559615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:19.560239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.560518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.560821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.561497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:19.561800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:19.563204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:19.589366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 74/151] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:19.596621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:19.618222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c87381-4d22-40a3-ae70-90f90269548c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:19.669085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:19.669857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.670271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.670553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.671842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:19.673424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:19.675407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 78/152] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:19 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:19.681675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:19.731919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:19.738966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2e7f5-458c-49fb-b4c1-95961fef4b32 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:19.781305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:19.782284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.782712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.783173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] PATH_INFO: `/v3/users/e0f3679c15be47799407fc79701aa756` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.788130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] RBAC: Authorizing `identity:get_user(user_id=e0f3679c15be47799407fc79701aa756)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:19.789853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:19.791666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 75/153] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:19 2022] GET /identity/v3/users/e0f3679c15be47799407fc79701aa756 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:19.798418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:19.806781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47b629-9c6c-41bb-94e2-4503868af775 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:19.855446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45cf6f-2c18-469c-914e-4f76e8f178a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:19.855446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45cf6f-2c18-469c-914e-4f76e8f178a5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.855446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45cf6f-2c18-469c-914e-4f76e8f178a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.855446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45cf6f-2c18-469c-914e-4f76e8f178a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.855914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45cf6f-2c18-469c-914e-4f76e8f178a5 None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=7c7828409b6d44438fbb82bf8a9c104d) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:19.855914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45cf6f-2c18-469c-914e-4f76e8f178a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:19.856888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45cf6f-2c18-469c-914e-4f76e8f178a5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:19.864278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 79/154] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:19 2022] GET /identity/v3/role_assignments?user.id=7c7828409b6d44438fbb82bf8a9c104d&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:19.871984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:19.903765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ca663-5678-4241-b97a-1f8c4731376e None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.904095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ca663-5678-4241-b97a-1f8c4731376e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.904445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ca663-5678-4241-b97a-1f8c4731376e None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.906684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 80/155] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:19.923278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8074-32c6-4a4f-bf92-7c5997067973 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:19.923656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8074-32c6-4a4f-bf92-7c5997067973 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:19.923882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8074-32c6-4a4f-bf92-7c5997067973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:19.957898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d27f8074-32c6-4a4f-bf92-7c5997067973 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:19.959118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d27f8074-32c6-4a4f-bf92-7c5997067973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:19.959894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e226e-d557-4de7-bedb-021abf6729cb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:20.024276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:20.025417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:20.025909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:20.026396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:20.027960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:20.030291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:20.032248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 76/156] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:19 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:20.038371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:20.040693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 81/157] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:20.189592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f3cce-d379-4aaf-ad80-b8a1908fc026 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:20.210685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:20.230949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:20.231642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:20.234074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:20.234074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49/users/e0f3679c15be47799407fc79701aa756/roles/81df27a3458948d98f5562812ed7280e` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:20.236690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=863360da8758425aa2e288263bd6db49, user_id=e0f3679c15be47799407fc79701aa756, role_id=81df27a3458948d98f5562812ed7280e)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:20.238300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:20.327536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 77/158] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:20 2022] PUT /identity/v3/projects/863360da8758425aa2e288263bd6db49/users/e0f3679c15be47799407fc79701aa756/roles/81df27a3458948d98f5562812ed7280e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:29:20.714671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f8074-32c6-4a4f-bf92-7c5997067973 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:20.742443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:20.834549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f8074-32c6-4a4f-bf92-7c5997067973 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:20.869916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27614-f278-44f8-9d49-5c48de58b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:20.870564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27614-f278-44f8-9d49-5c48de58b458 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:20.870846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27614-f278-44f8-9d49-5c48de58b458 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:20.871120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27614-f278-44f8-9d49-5c48de58b458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:20.881779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27614-f278-44f8-9d49-5c48de58b458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-3cf27614-f278-44f8-9d49-5c48de58b458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:20.886733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:20.887633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:20.888499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 82/159] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:20.894286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:20.972515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7d05-e96b-4904-a2cf-111297216358 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:20.972816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7d05-e96b-4904-a2cf-111297216358 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:20.972992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7d05-e96b-4904-a2cf-111297216358 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:20.975181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 83/160] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:29:20.985734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde51f8f-790d-44a5-86dd-98cd929cb155 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:20.986059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde51f8f-790d-44a5-86dd-98cd929cb155 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:20.986292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde51f8f-790d-44a5-86dd-98cd929cb155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:21.013095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-fde51f8f-790d-44a5-86dd-98cd929cb155 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:21.015511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fde51f8f-790d-44a5-86dd-98cd929cb155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:21.077210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a69301-b99a-46d0-b5a1-c3db4de4d6b1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:21.144705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7e9d5-bb17-4f28-bafe-9d495f30688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:21.145320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7e9d5-bb17-4f28-bafe-9d495f30688f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:21.145598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7e9d5-bb17-4f28-bafe-9d495f30688f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:21.145871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7e9d5-bb17-4f28-bafe-9d495f30688f None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:21.148954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7e9d5-bb17-4f28-bafe-9d495f30688f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:21.149273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7e9d5-bb17-4f28-bafe-9d495f30688f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:21.150672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7e9d5-bb17-4f28-bafe-9d495f30688f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:21.156379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 84/161] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:21.166762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 78/162] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:21.172797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde51f8f-790d-44a5-86dd-98cd929cb155 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:21.193977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:21.309095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde51f8f-790d-44a5-86dd-98cd929cb155 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:21.341785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85d9f3-fffd-4edb-bade-2b370c4f0aa3 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:21.342310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85d9f3-fffd-4edb-bade-2b370c4f0aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:21.342406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85d9f3-fffd-4edb-bade-2b370c4f0aa3 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:21.343996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 79/163] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:29:21.357872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd52da4-776f-46e6-9a1a-52ddaf5a570b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:21.358136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd52da4-776f-46e6-9a1a-52ddaf5a570b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:21.358420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd52da4-776f-46e6-9a1a-52ddaf5a570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:21.370115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2865-3324-43ca-ba31-80357be736af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:21.370773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2865-3324-43ca-ba31-80357be736af None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:21.371049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2865-3324-43ca-ba31-80357be736af None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:21.371320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2865-3324-43ca-ba31-80357be736af None admin] PATH_INFO: `/v3/users/b229946b8c534cd194a31028b1b40cec` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:21.376123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2865-3324-43ca-ba31-80357be736af None admin] RBAC: Authorizing `identity:get_user(user_id=b229946b8c534cd194a31028b1b40cec)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:21.379351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2865-3324-43ca-ba31-80357be736af None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:21.379563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 85/164] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:21 2022] GET /identity/v3/users/b229946b8c534cd194a31028b1b40cec => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:21.387547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0fd52da4-776f-46e6-9a1a-52ddaf5a570b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:21.389390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0fd52da4-776f-46e6-9a1a-52ddaf5a570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:21.396838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2865-3324-43ca-ba31-80357be736af None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:21.453690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:21.518114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 80/165] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:21.534937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:21.557545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2865-3324-43ca-ba31-80357be736af None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:21.601345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:21.601882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:21.602159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:21.602429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:21.680299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:21.681880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:21.778941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd52da4-776f-46e6-9a1a-52ddaf5a570b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:21.795111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:21.824594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 86/166] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:29:21.831190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:21.978198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd52da4-776f-46e6-9a1a-52ddaf5a570b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:22.018572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f087-3610-4d90-b2ef-705719c75e67 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:22.074487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:22.075575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.076031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.076652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:22.077479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.077737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.078012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.078138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.079445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:22.081090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:22.082904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 87/167] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:21 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:22.084010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:22.104849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:22.112284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:22.113416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:22.114261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:22.118683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 81/168] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:22.121322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:22.184193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:22.187899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:22.292485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef80e19-9879-44ff-bfa8-51f21f1a95ae None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:22.298881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3297cf-cf97-40cc-85cb-e57e6f6f1580 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:22.379181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:22.380978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.381720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.382632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.383398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:22.384499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.385403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.385986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.388080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=b229946b8c534cd194a31028b1b40cec) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:22.389200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:22.394306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:22.401001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 82/169] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:22 2022] GET /identity/v3/role_assignments?user.id=b229946b8c534cd194a31028b1b40cec&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:22.402005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:22.416421 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:22.422083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:22.423279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:22.424332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 88/170] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:22.429087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:22.539332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:22.552273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae59af-ab8b-4fe4-b4ce-63ee847c3b58 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:22.592328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6f98d-bd75-4cc0-901f-faf194520cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:22.594384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6f98d-bd75-4cc0-901f-faf194520cdd None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.594832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6f98d-bd75-4cc0-901f-faf194520cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.595261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6f98d-bd75-4cc0-901f-faf194520cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.596139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6f98d-bd75-4cc0-901f-faf194520cdd None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:22.596649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6f98d-bd75-4cc0-901f-faf194520cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:22.598504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6f98d-bd75-4cc0-901f-faf194520cdd None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:22.610615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 83/171] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:22.612868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b069e9-46ab-4369-9151-14b2a47de226 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.614286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b069e9-46ab-4369-9151-14b2a47de226 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.614733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b069e9-46ab-4369-9151-14b2a47de226 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.616185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 84/172] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:22.630667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4379a-bcba-4794-bf13-6544d3c59429 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.631215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4379a-bcba-4794-bf13-6544d3c59429 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.631665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4379a-bcba-4794-bf13-6544d3c59429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.655555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-39f4379a-bcba-4794-bf13-6544d3c59429 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:22.657428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-39f4379a-bcba-4794-bf13-6544d3c59429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:22.689499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3addf8-b496-4cb8-b582-5f2b5db7383c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:22.710192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:22.753006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 85/173] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:22.755131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4379a-bcba-4794-bf13-6544d3c59429 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:22.768241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:22.768904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.769156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.769433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.770123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:22.770432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:22.771841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:22.785559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 89/174] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:22.791258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:22.863439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:22.893706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4379a-bcba-4794-bf13-6544d3c59429 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:22.944202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:22.945336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:22.945796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:22.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:22.947580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:22.950161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:22.952641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 86/175] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:22 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:22.959178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:23.014669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c9dd6-1aa5-416b-bc06-bd176e095695 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:23.093672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:23.094545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.094988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.095448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] PATH_INFO: `/v3/users/7c7828409b6d44438fbb82bf8a9c104d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.100697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7828409b6d44438fbb82bf8a9c104d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:23.102427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:23.104301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 90/176] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:22 2022] GET /identity/v3/users/7c7828409b6d44438fbb82bf8a9c104d => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:23.110528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:23.165475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:23.165657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712cd1-c4c7-45f0-9e8c-a03dbf9fe4d7 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:23.243929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e46da-795a-4090-82e3-1cff50590fc7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:23.252077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:23.252700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.252980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.253256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.297032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf52b-f428-41a6-a239-e983eaf744e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:23.297544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:23.297652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf52b-f428-41a6-a239-e983eaf744e9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.297929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf52b-f428-41a6-a239-e983eaf744e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.298198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf52b-f428-41a6-a239-e983eaf744e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.416414 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:23.421550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:23.453382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaf52b-f428-41a6-a239-e983eaf744e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:23.454959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaf52b-f428-41a6-a239-e983eaf744e9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:23.500529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:23.570382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 87/177] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:23.571236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:23.578986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 91/178] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:23.581144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58aa48-c570-47b0-bde9-994f6906596f None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.581680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58aa48-c570-47b0-bde9-994f6906596f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.582170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58aa48-c570-47b0-bde9-994f6906596f None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.584659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 92/179] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:23.585579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58aa48-c570-47b0-bde9-994f6906596f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:23.634643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:23.692404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114ddd3-1bc2-4138-b6da-d3e83eb2fd61 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:23.718332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58aa48-c570-47b0-bde9-994f6906596f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:23.728488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:23.729123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.729520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.729796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.741993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:23.749185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:23.750075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:23.750891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 88/180] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:23.751582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:23.761014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34c527-9aa1-41d6-bbd0-0e7fa5d333e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:23.761675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34c527-9aa1-41d6-bbd0-0e7fa5d333e9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.761955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34c527-9aa1-41d6-bbd0-0e7fa5d333e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.762226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34c527-9aa1-41d6-bbd0-0e7fa5d333e9 None admin] PATH_INFO: `/v3/projects/b79f464c53e64ebaa9eb0425295d9f45` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.763405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34c527-9aa1-41d6-bbd0-0e7fa5d333e9 None admin] RBAC: Authorizing `identity:get_project(project_id=b79f464c53e64ebaa9eb0425295d9f45)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:23.765303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34c527-9aa1-41d6-bbd0-0e7fa5d333e9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:23.767068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 93/181] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:23 2022] GET /identity/v3/projects/b79f464c53e64ebaa9eb0425295d9f45 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:23.768608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2689-9a44-4b76-9fa9-1ccad684e8f9 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.768891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2689-9a44-4b76-9fa9-1ccad684e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.769163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b2689-9a44-4b76-9fa9-1ccad684e8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.783091 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:23.788505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f33b2689-9a44-4b76-9fa9-1ccad684e8f9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:23.795454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f33b2689-9a44-4b76-9fa9-1ccad684e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:23.873625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 94/182] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:23.873625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3cb21-b6fc-42ae-853e-6df5c7b25c75 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.873625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3cb21-b6fc-42ae-853e-6df5c7b25c75 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.873625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3cb21-b6fc-42ae-853e-6df5c7b25c75 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.873625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 95/183] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:23.873625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3cb21-b6fc-42ae-853e-6df5c7b25c75 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:23.878804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f90e4-071b-41e0-9736-8d9b7a67f548 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:23.893607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:23.922080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:23.922919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:23.925794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:23.926320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:23.927943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:23.929708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:23.932667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 89/184] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:23 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:23.933747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.009268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3cb21-b6fc-42ae-853e-6df5c7b25c75 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.039763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f04957-cf17-413a-a546-f61cf6efd500 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.049837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f6079-e30e-469c-9dec-8d4af5444457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.050560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6079-e30e-469c-9dec-8d4af5444457 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.050840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6079-e30e-469c-9dec-8d4af5444457 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.051118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6079-e30e-469c-9dec-8d4af5444457 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.051812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f6079-e30e-469c-9dec-8d4af5444457 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:24.052112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f6079-e30e-469c-9dec-8d4af5444457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:24.053702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f6079-e30e-469c-9dec-8d4af5444457 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:24.055989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.063318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 96/185] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:24.064972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1625ec-ad6c-493f-b1d3-92133a9119c4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.072511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1625ec-ad6c-493f-b1d3-92133a9119c4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.072511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1625ec-ad6c-493f-b1d3-92133a9119c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.079177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcc4ea-7de3-49e3-840d-9cd114efb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.079819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcc4ea-7de3-49e3-840d-9cd114efb54c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.080094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcc4ea-7de3-49e3-840d-9cd114efb54c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.080374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcc4ea-7de3-49e3-840d-9cd114efb54c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.081086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcc4ea-7de3-49e3-840d-9cd114efb54c None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=b79f464c53e64ebaa9eb0425295d9f45, user.id=7c7828409b6d44438fbb82bf8a9c104d) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:24.081387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcc4ea-7de3-49e3-840d-9cd114efb54c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:24.082815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcc4ea-7de3-49e3-840d-9cd114efb54c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:24.085026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-cc1625ec-ad6c-493f-b1d3-92133a9119c4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:24.087166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cc1625ec-ad6c-493f-b1d3-92133a9119c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:24.088529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 90/186] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:23 2022] GET /identity/v3/role_assignments?user.id=7c7828409b6d44438fbb82bf8a9c104d&scope.project.id=b79f464c53e64ebaa9eb0425295d9f45&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:24.089664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650c25-e219-410b-af7b-8d3b672d06bf None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.089933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650c25-e219-410b-af7b-8d3b672d06bf None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.090203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650c25-e219-410b-af7b-8d3b672d06bf None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.096718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 91/187] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:24.096718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650c25-e219-410b-af7b-8d3b672d06bf None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.159181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.191451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 97/188] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:24.191451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1625ec-ad6c-493f-b1d3-92133a9119c4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.232130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650c25-e219-410b-af7b-8d3b672d06bf None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.273807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2487b-4af8-4c48-8378-41f1cd0f8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.274343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2487b-4af8-4c48-8378-41f1cd0f8f25 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.274618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2487b-4af8-4c48-8378-41f1cd0f8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.274890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2487b-4af8-4c48-8378-41f1cd0f8f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.275653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2487b-4af8-4c48-8378-41f1cd0f8f25 None admin] RBAC: Adding query filter params (role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=7c7828409b6d44438fbb82bf8a9c104d) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:24.275964 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2487b-4af8-4c48-8378-41f1cd0f8f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:24.277421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2487b-4af8-4c48-8378-41f1cd0f8f25 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:24.284483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 92/189] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/role_assignments?user.id=7c7828409b6d44438fbb82bf8a9c104d&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:24.287493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5a8bf-6770-4537-8890-7767c6d84043 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.287493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5a8bf-6770-4537-8890-7767c6d84043 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.287493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5a8bf-6770-4537-8890-7767c6d84043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.306371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-08e5a8bf-6770-4537-8890-7767c6d84043 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:24.308506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-08e5a8bf-6770-4537-8890-7767c6d84043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:24.314876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1625ec-ad6c-493f-b1d3-92133a9119c4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.352662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.362012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.362806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.363089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.363362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] PATH_INFO: `/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.381785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] RBAC: Authorizing `identity:get_user(user_id=a50c7a670a864db1bf9f5611d0cbfd3d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:24.383474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:24.385747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 98/190] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:24.387847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.400919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 93/191] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:24.401814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5a8bf-6770-4537-8890-7767c6d84043 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.460980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.538310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977e3b-d3fa-443b-9868-4c81b35babd3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.559400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5a8bf-6770-4537-8890-7767c6d84043 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.587578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.588222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.588507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.588785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.589969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:24.591593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:24.593770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 99/192] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:24.596581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.602182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.602988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.603320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.604412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.665653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.677195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:24.679114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:24.715078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd9e0-633c-4c1c-bb83-dd65d11d9a58 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.718375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.749766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.750403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.750684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.750958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.761003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:24.767446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:24.768384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 100/193] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:24.774233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.780668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 94/194] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:24.784213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.869376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcbdc6-e5de-4a4b-9b84-411658a5636a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.881787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc12a3-d54d-4575-a922-6cdf8cbfdff8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:24.883117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.903846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.904495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.904775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.905152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.905815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:24.907351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:24.917769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:24.918612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:24.919044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:24.919169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:24.926175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:24.930389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:24.935229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:24.936984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 95/195] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:24.938268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:24.994584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 101/196] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:29:24 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:24.996550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.043429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00815cca-7ccc-497a-8063-5c4b81584875 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.081568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.082192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.082469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.082740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.083453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:25.083750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.085167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:25.098848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 96/197] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:25.098848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.116454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a4c0-9b18-4343-91f9-eee12da053dc None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.153727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.154374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.154660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.154981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.156300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.157882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:25.164345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 102/198] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:24 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:25.164345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.167485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:25.213445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:25.216435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408b811-d1fe-42c2-8e97-0b7c34818b94 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.252679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.253288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.253568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.253836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.254502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:25.254802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.256225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:25.266344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 97/199] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:25.267193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.287162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b9a36-9c36-43ca-a7d8-99ebd333b591 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.334859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.335647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.335811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.336072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] PATH_INFO: `/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.338269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] RBAC: Authorizing `identity:get_user(user_id=a50c7a670a864db1bf9f5611d0cbfd3d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.339745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:25.341793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 103/200] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:25 2022] GET /identity/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:25.342641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.394696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d205ed-21cb-43ba-99ea-60488c599c13 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.421690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:25.433463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.436706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.436706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.436706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.436706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=a50c7a670a864db1bf9f5611d0cbfd3d) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:25.436706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.438146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:25.444113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 98/201] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:25 2022] GET /identity/v3/role_assignments?user.id=a50c7a670a864db1bf9f5611d0cbfd3d&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:25.445209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.470451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f786-246f-40e1-954f-4f9f00208d8f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.488671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:25.545392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.546447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.546873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.547291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] PATH_INFO: `/v3/users/e0f3679c15be47799407fc79701aa756` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.552174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f3679c15be47799407fc79701aa756)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.553838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:25.555680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 104/202] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:25 2022] GET /identity/v3/users/e0f3679c15be47799407fc79701aa756 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:25.561410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.597092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab170-303c-4125-abef-14d7d8b86e15 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.653935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.655248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.655365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.655644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.720356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:25.731607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.733270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:25.754598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce5df-4e03-44bb-9d1a-da9284dd58c1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:25.852464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:25.853087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:25.853373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:25.853650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:25.953601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:25.983862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 99/203] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:25.989632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:25.992166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:25.993874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:26.160463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:26.187799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 105/204] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:29:26.188933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30105e-9ce6-41a0-8055-9f91f780aba2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:26.193519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:26.272125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:26.272776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:26.273056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:26.273331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:26.274034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:26.274606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:26.275976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:26.277715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 100/205] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:25 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:26.283394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:26.300749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214a2f1-9a93-4b16-92f2-9c4e77d844c7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:26.345397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:26.347048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:26.348365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:26.349471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:26.351997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:26.353820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:26.356518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 106/206] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:26 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:26.362583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:26.459278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a41e2-2e35-4de0-a0e1-ba4b6a48d4cc None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:26.499029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9d313-e9a4-4604-8961-f3d4566e3afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:26.500129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9d313-e9a4-4604-8961-f3d4566e3afe None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:26.500638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9d313-e9a4-4604-8961-f3d4566e3afe None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:26.501120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9d313-e9a4-4604-8961-f3d4566e3afe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:26.502058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9d313-e9a4-4604-8961-f3d4566e3afe None admin] RBAC: Adding query filter params (role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=a50c7a670a864db1bf9f5611d0cbfd3d) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:26.502573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9d313-e9a4-4604-8961-f3d4566e3afe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:26.504271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9d313-e9a4-4604-8961-f3d4566e3afe None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:26.510609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 101/207] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:26 2022] GET /identity/v3/role_assignments?user.id=a50c7a670a864db1bf9f5611d0cbfd3d&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:26.557374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991380b-1deb-41ac-97d3-2665ced1fcf8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:26.595536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738389a-bc0a-48a0-8692-bec9e8bb1d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:26.596231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738389a-bc0a-48a0-8692-bec9e8bb1d0e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:26.596513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738389a-bc0a-48a0-8692-bec9e8bb1d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:26.596788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738389a-bc0a-48a0-8692-bec9e8bb1d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:26.597577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738389a-bc0a-48a0-8692-bec9e8bb1d0e None admin] RBAC: Adding query filter params (role.id=81df27a3458948d98f5562812ed7280e, scope.project.id=863360da8758425aa2e288263bd6db49, user.id=e0f3679c15be47799407fc79701aa756) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:26.597914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738389a-bc0a-48a0-8692-bec9e8bb1d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:26.599361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738389a-bc0a-48a0-8692-bec9e8bb1d0e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:26.606188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 107/208] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:26 2022] GET /identity/v3/role_assignments?user.id=e0f3679c15be47799407fc79701aa756&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=81df27a3458948d98f5562812ed7280e => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:27.509294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7a735-cbf1-48ce-8538-39c425e1e99b None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:27.510321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7a735-cbf1-48ce-8538-39c425e1e99b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:27.510840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7a735-cbf1-48ce-8538-39c425e1e99b None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:27.512464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 102/209] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:27.518569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d2ba-7e03-4826-a735-3d040e3f1dec None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:27.519380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d2ba-7e03-4826-a735-3d040e3f1dec None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:27.519887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d2ba-7e03-4826-a735-3d040e3f1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:27.534574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:27.540383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d3a4d2ba-7e03-4826-a735-3d040e3f1dec None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:27.541801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d3a4d2ba-7e03-4826-a735-3d040e3f1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:27.617633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 108/210] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:27.696779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a336f-36e1-404e-a2cc-a8eb0a431462 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:27.697437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a336f-36e1-404e-a2cc-a8eb0a431462 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:27.697952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a336f-36e1-404e-a2cc-a8eb0a431462 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:27.699611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 103/211] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:27.705856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e514-deff-4c55-b0a6-c4d72444f622 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:27.706948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e514-deff-4c55-b0a6-c4d72444f622 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:27.706948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e514-deff-4c55-b0a6-c4d72444f622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:27.724703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5cd5e514-deff-4c55-b0a6-c4d72444f622 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:27.725876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5cd5e514-deff-4c55-b0a6-c4d72444f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:27.795743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 109/212] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:27.897884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a336f-36e1-404e-a2cc-a8eb0a431462 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:27.903327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00b2f-ac0b-40fa-9a77-bf26c472faa7 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:27.903638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00b2f-ac0b-40fa-9a77-bf26c472faa7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:27.904711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c00b2f-ac0b-40fa-9a77-bf26c472faa7 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:27.905775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 110/213] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:27.910803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b62cf-f1fb-4ff5-bbf0-37e310ba31e0 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:27.911194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b62cf-f1fb-4ff5-bbf0-37e310ba31e0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:27.911529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b62cf-f1fb-4ff5-bbf0-37e310ba31e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:27.926535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:27.930333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b31b62cf-f1fb-4ff5-bbf0-37e310ba31e0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:27.931669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b31b62cf-f1fb-4ff5-bbf0-37e310ba31e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:27.992917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:28.007802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 111/214] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:28.024009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a336f-36e1-404e-a2cc-a8eb0a431462 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.061381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.062335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.062859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.063330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.064720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:28.066593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:28.068836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 104/215] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:28.075484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b62cf-f1fb-4ff5-bbf0-37e310ba31e0 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.084276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.175303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b62cf-f1fb-4ff5-bbf0-37e310ba31e0 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.182243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:28.202129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b4e7-527b-45d5-a893-b9a6e1232d1a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.213857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.214658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.215105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.215571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.216247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:28.219551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:28.245558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.246543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.247038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.247573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.258482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:28.264326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:28.268215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:28.269079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 105/216] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:28.271484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.319614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 112/217] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:29:28 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:28.319614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.398254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d180fa-f1c9-4f46-9b03-c04ede83bfac None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.404684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:28.450274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.451538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.451888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.452165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.452949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:28.453934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:28.455741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:28.466628 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eac251-c430-47cb-a63c-183d5355b2e8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.471951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 106/218] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:28.474209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.495206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:28.517202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.517911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.518196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.518477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.530540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:28.537691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:28.538576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:28.539378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 113/219] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:28.545770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.619629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cff492-2454-4d2b-a236-29de23ee75d9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.660997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.661644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.661924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.662197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] PATH_INFO: `/v3/users/4411f712bb1f4f52899ba488337f2c8f` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.668836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3cc9-1de0-4a6f-9c22-f138b387dcaa None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.679796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] RBAC: Authorizing `identity:get_user(user_id=4411f712bb1f4f52899ba488337f2c8f)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:28.681615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:28.685116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 107/220] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/users/4411f712bb1f4f52899ba488337f2c8f => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:28.687752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:28.691827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.712729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.713357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.713638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.713917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.715999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:28.716437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:28.718179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:28.730237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 114/221] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:28.736738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.773603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:28.816140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfebbde-ae38-4c93-a950-5e736a2a0f5d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.868338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baea8a-c678-4a9a-a77d-de9104403267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.873994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baea8a-c678-4a9a-a77d-de9104403267 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.873994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baea8a-c678-4a9a-a77d-de9104403267 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.873994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baea8a-c678-4a9a-a77d-de9104403267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.895087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68424f7a-9e17-47f4-9450-77724975ebf2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:28.944720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b65b-571b-493b-b775-7e4fd75b9d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:28.945358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b65b-571b-493b-b775-7e4fd75b9d4c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.945636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b65b-571b-493b-b775-7e4fd75b9d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.945906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b65b-571b-493b-b775-7e4fd75b9d4c None admin] PATH_INFO: `/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.947041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b65b-571b-493b-b775-7e4fd75b9d4c None admin] RBAC: Authorizing `identity:get_user(user_id=a50c7a670a864db1bf9f5611d0cbfd3d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:28.948580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b65b-571b-493b-b775-7e4fd75b9d4c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:28.950535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 115/222] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:28.952641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c02d7-5b5f-4cfc-802e-a08c9dad66ef None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:28.952923 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c02d7-5b5f-4cfc-802e-a08c9dad66ef None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:28.953196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c02d7-5b5f-4cfc-802e-a08c9dad66ef None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:28.954655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 116/223] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:28.958264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c02d7-5b5f-4cfc-802e-a08c9dad66ef None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:28.977382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baea8a-c678-4a9a-a77d-de9104403267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:28.979069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baea8a-c678-4a9a-a77d-de9104403267 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:29.010614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:29.050105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:29.071097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c02d7-5b5f-4cfc-802e-a08c9dad66ef None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:29.094178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 108/224] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:29.095577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8029d-aa60-45d3-8492-88b55519fbf2 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:29.095986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8029d-aa60-45d3-8492-88b55519fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:29.096267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8029d-aa60-45d3-8492-88b55519fbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:29.109174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:29.110209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:29.110781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:29.111249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:29.112622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:29.114245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:29.115876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-bfb8029d-aa60-45d3-8492-88b55519fbf2 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:29.116660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 117/225] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:28 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:29.117173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-bfb8029d-aa60-45d3-8492-88b55519fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:29.117866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:29.211743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 109/226] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:29.212892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8029d-aa60-45d3-8492-88b55519fbf2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:29.250965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac298e-316d-40e3-b847-91fbe7d18b69 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:29.263053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:29.291527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:29.292339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:29.292621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:29.292892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:29.294016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:29.299193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:29.299193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 118/227] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:29 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:29.306102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:29.432480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321182-4b4e-4e55-b0e2-dd71b3d5a28a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:29.469164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:29.469969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:29.470249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:29.470517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:29.471247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=4411f712bb1f4f52899ba488337f2c8f) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:29.471603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:29.473101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:29.479444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 119/228] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:29 2022] GET /identity/v3/role_assignments?user.id=4411f712bb1f4f52899ba488337f2c8f&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:29.495112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:29.501969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8029d-aa60-45d3-8492-88b55519fbf2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:29.526230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:29.552610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:29.553305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:29.553586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:29.553860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/a50c7a670a864db1bf9f5611d0cbfd3d/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:29.562753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] RBAC: Authorizing `identity:create_grant(project_id=a60c137f78554bd7bd0e17ec9005b3d8, user_id=a50c7a670a864db1bf9f5611d0cbfd3d, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:29.562753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:29.600230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:29.635943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 110/229] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:29 2022] PUT /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/a50c7a670a864db1bf9f5611d0cbfd3d/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:29.692743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51068b8-ecad-4e90-b925-046ab4b6eb51 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:29.746908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:29.747773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:29.748101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:29.748402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:29.769102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:29.774927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:29.775919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:29.777173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 120/230] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:29.783464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:29.911183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2529443-657a-418d-b1db-cc5f5026afdc None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:29.951846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:29.952545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:29.952830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:29.953107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:29.953787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:29.954088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:29.955528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:29.964692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 111/231] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:29.971014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:30.102587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab1e2-d9b1-4838-a7d4-b612c4d418f1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:30.104163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:30.156986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:30.157635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:30.157922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:30.158202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] PATH_INFO: `/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:30.159352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] RBAC: Authorizing `identity:get_user(user_id=a50c7a670a864db1bf9f5611d0cbfd3d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:30.160829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:30.162575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 121/232] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:29 2022] GET /identity/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:30.167972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:30.202224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:30.304170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db096c6b-7655-4b21-9ad9-82d01ce1b461 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:30.347170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee5837-5edc-44bc-b340-808cdf8473c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:30.348227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee5837-5edc-44bc-b340-808cdf8473c7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:30.348781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee5837-5edc-44bc-b340-808cdf8473c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:30.349255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee5837-5edc-44bc-b340-808cdf8473c7 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:30.350716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee5837-5edc-44bc-b340-808cdf8473c7 None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:30.352394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee5837-5edc-44bc-b340-808cdf8473c7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:30.354285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 112/233] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:30 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:30.360600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:30.473760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be596a31-04a8-49da-ba6a-d85508b3428c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:30.509289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d8578-e76c-4ff6-a3d9-73b021c9ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:30.509959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8578-e76c-4ff6-a3d9-73b021c9ebb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:30.510241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8578-e76c-4ff6-a3d9-73b021c9ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:30.510519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d8578-e76c-4ff6-a3d9-73b021c9ebb2 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/a50c7a670a864db1bf9f5611d0cbfd3d/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:30.512715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d8578-e76c-4ff6-a3d9-73b021c9ebb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a60c137f78554bd7bd0e17ec9005b3d8, user_id=a50c7a670a864db1bf9f5611d0cbfd3d, role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:30.514557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d8578-e76c-4ff6-a3d9-73b021c9ebb2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:30.584594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 122/234] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:30 2022] PUT /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/a50c7a670a864db1bf9f5611d0cbfd3d/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:30.875668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2eef-4140-4ee9-9da9-55f4895b65f7 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:30.876188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2eef-4140-4ee9-9da9-55f4895b65f7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:30.876188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc2eef-4140-4ee9-9da9-55f4895b65f7 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:30.877889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 113/235] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:30.896359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0dd2c-f33b-4f4e-8c08-3cc68ef958e4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:30.896898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0dd2c-f33b-4f4e-8c08-3cc68ef958e4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:30.896898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0dd2c-f33b-4f4e-8c08-3cc68ef958e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:30.924597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b1a0dd2c-f33b-4f4e-8c08-3cc68ef958e4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:30.925836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b1a0dd2c-f33b-4f4e-8c08-3cc68ef958e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:30.957309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:31.009171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 123/236] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:31.150996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199f02-9440-4106-bb4b-b1d7ff19bbb5 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:31.151289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199f02-9440-4106-bb4b-b1d7ff19bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:31.151496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13199f02-9440-4106-bb4b-b1d7ff19bbb5 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:31.152839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 114/237] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:31.163705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c659-2f01-4d75-b4c0-eb7af7cbbbe1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:31.164001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c659-2f01-4d75-b4c0-eb7af7cbbbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:31.164274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c659-2f01-4d75-b4c0-eb7af7cbbbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:31.187302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a8d1c659-2f01-4d75-b4c0-eb7af7cbbbe1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:31.188535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a8d1c659-2f01-4d75-b4c0-eb7af7cbbbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:31.274410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 124/238] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:31.377454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13199f02-9440-4106-bb4b-b1d7ff19bbb5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:31.485362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:31.505127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13199f02-9440-4106-bb4b-b1d7ff19bbb5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:31.550303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:31.550977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:31.551259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:31.551564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:31.566234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:31.571169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:31.572082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:31.572909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 115/239] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:31.578505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c659-2f01-4d75-b4c0-eb7af7cbbbe1 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:31.587672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:31.731380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:31.738944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c659-2f01-4d75-b4c0-eb7af7cbbbe1 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:31.776394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3fbf-d8b0-49d9-bac0-7e2853f8bccb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:31.791901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:31.792523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:31.792801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:31.793074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:31.793742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:31.794042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:31.796060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:31.815146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 125/240] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:31.820532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:31.843431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:31.844062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:31.844335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:31.844600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:31.846508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:31.850522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:31.853081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 116/241] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:31.860490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:31.891679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:31.971448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0ba86-e6f0-48b4-a2e3-7efc7ccb1f9b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:32.012873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:32.014034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.014339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.014610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] PATH_INFO: `/v3/users/41a82bba298b40418e91f27acba63939` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.046301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] RBAC: Authorizing `identity:get_user(user_id=41a82bba298b40418e91f27acba63939)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:32.047783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:32.049637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 126/242] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:31 2022] GET /identity/v3/users/41a82bba298b40418e91f27acba63939 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:32.054855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:32.078061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594f6e-38e7-498f-a40f-19a2f0d1dc59 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:32.084552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:32.130919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d140a2-b3c4-4943-8007-c8616d629fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:32.131572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d140a2-b3c4-4943-8007-c8616d629fd5 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.131849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d140a2-b3c4-4943-8007-c8616d629fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.132118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d140a2-b3c4-4943-8007-c8616d629fd5 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.132787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d140a2-b3c4-4943-8007-c8616d629fd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:32.134251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d140a2-b3c4-4943-8007-c8616d629fd5 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:32.209101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba2af-b0c7-4107-8f6b-5163e3c780e3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:32.223769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 117/243] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:29:31 2022] POST /identity/v3/users => generated 293 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:32.253033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:32.253658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.253934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.254204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.332129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:32.333546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:32.355825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:32.409559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086af6c-07a0-4cab-99c7-0b39e427494a None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.409885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086af6c-07a0-4cab-99c7-0b39e427494a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.410106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086af6c-07a0-4cab-99c7-0b39e427494a None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.411690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 118/244] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:29:32.417023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a152-ffab-4b83-8233-0488a516e904 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.417658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a152-ffab-4b83-8233-0488a516e904 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.418127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a152-ffab-4b83-8233-0488a516e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.451812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-2f78a152-ffab-4b83-8233-0488a516e904 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:32.453491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2f78a152-ffab-4b83-8233-0488a516e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:32.455475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 127/245] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:32.460006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:32.551736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:32.561374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 119/246] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:32.593910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde52f8-1277-4ac5-9c93-b2732f551d66 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.594397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde52f8-1277-4ac5-9c93-b2732f551d66 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.594876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde52f8-1277-4ac5-9c93-b2732f551d66 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.596429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 120/247] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:29:32.602289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f243-7c65-4100-866e-f72eac6850a8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.602564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f243-7c65-4100-866e-f72eac6850a8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.602833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f243-7c65-4100-866e-f72eac6850a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.627306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-47e1f243-7c65-4100-866e-f72eac6850a8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:32.628452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a75c8-7287-4078-857e-7eab028b1f44 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:32.628563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-47e1f243-7c65-4100-866e-f72eac6850a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:32.640093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:32.667121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:32.668245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.668723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.669192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.671331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:32.673009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:32.676234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 128/248] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:32 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:32.682248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:32.709279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 121/249] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:32.798086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68986ad-9a9c-4582-8c55-05f31127dfd1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:32.835202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:32.835831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:32.836110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:32.836379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:32.837100 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] RBAC: Adding query filter params (role.id=81df27a3458948d98f5562812ed7280e, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=41a82bba298b40418e91f27acba63939) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:32.837404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:32.838829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:32.845463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 129/250] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:32 2022] GET /identity/v3/role_assignments?user.id=41a82bba298b40418e91f27acba63939&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=81df27a3458948d98f5562812ed7280e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:32.861163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f243-7c65-4100-866e-f72eac6850a8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:32.992276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f243-7c65-4100-866e-f72eac6850a8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:33.026757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:33.036134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:33.036797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.037168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.037440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.052439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:33.057662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:33.058587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:33.059394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 122/251] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:33.065374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:33.071116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:33.125253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:33.186407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6a6d5-be6a-462c-987b-1e7dd449064e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:33.191348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfff26e-fa27-4748-962c-a943fe555495 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:33.222079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:33.222701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.222978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.223248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.223955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:33.224254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:33.225606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:33.229147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:33.229786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.230064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.230339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.236135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 130/252] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:33.242098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:33.246987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:33.248425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:33.249249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 123/253] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:33.250514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:33.256179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:33.357573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:33.413583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4fab-e2a6-4512-a533-0a3279030145 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:33.416443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:33.453631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a7990-0cd3-47c0-a4a4-54c63d481cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:33.454283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7990-0cd3-47c0-a4a4-54c63d481cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.454558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7990-0cd3-47c0-a4a4-54c63d481cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.454828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a7990-0cd3-47c0-a4a4-54c63d481cf9 None admin] PATH_INFO: `/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.455998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a7990-0cd3-47c0-a4a4-54c63d481cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=a50c7a670a864db1bf9f5611d0cbfd3d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:33.458129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a7990-0cd3-47c0-a4a4-54c63d481cf9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:33.459215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3bd8d-4f2e-418d-9205-40a47b93d3ac None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:33.460013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 131/254] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:33.461396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c155c-0807-4fbf-bdb0-ed3ab89365b7 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.462489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c155c-0807-4fbf-bdb0-ed3ab89365b7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.462781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c155c-0807-4fbf-bdb0-ed3ab89365b7 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.464153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 132/255] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:33.466221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c155c-0807-4fbf-bdb0-ed3ab89365b7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:33.501912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7e421-7d3f-453f-a7f7-2b032f6a08de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:33.502523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7e421-7d3f-453f-a7f7-2b032f6a08de None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.502799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7e421-7d3f-453f-a7f7-2b032f6a08de None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.503071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7e421-7d3f-453f-a7f7-2b032f6a08de None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.503874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7e421-7d3f-453f-a7f7-2b032f6a08de None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:33.504178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7e421-7d3f-453f-a7f7-2b032f6a08de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:33.505677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7e421-7d3f-453f-a7f7-2b032f6a08de None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:33.523345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 124/256] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:33.524696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588617d9-7d85-47b3-81ee-249b33799ed7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.524980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588617d9-7d85-47b3-81ee-249b33799ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.525254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588617d9-7d85-47b3-81ee-249b33799ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.558224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-588617d9-7d85-47b3-81ee-249b33799ed7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:33.559439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-588617d9-7d85-47b3-81ee-249b33799ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:33.598384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c155c-0807-4fbf-bdb0-ed3ab89365b7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:33.672781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 125/257] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:33.673371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588617d9-7d85-47b3-81ee-249b33799ed7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:33.685504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:33.686132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.686407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.686678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.735918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:33.771764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:33.801438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588617d9-7d85-47b3-81ee-249b33799ed7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:33.824657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:33.826411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:33.936162 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:33.936825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:33.937105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:33.937449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] PATH_INFO: `/v3/users/4411f712bb1f4f52899ba488337f2c8f` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:33.939041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] RBAC: Authorizing `identity:get_user(user_id=4411f712bb1f4f52899ba488337f2c8f)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:33.940533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:33.940816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 133/258] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:29:33.942238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 126/259] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/users/4411f712bb1f4f52899ba488337f2c8f => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:33.946067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:33.948359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:34.102692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:34.158770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdc6a4-cc7b-429d-8cea-ceb6981d591c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:34.172344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130b3ba-4696-4b62-ac58-0e80b3cfd1aa None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:34.188037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:34.212154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:34.212962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:34.213241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:34.213516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:34.214748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:34.216422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:34.218677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 127/260] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:34.219753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:34.233087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:34.234077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:34.234551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:34.235031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:34.236389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:34.238027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:34.239900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 134/261] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:33 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:34.240886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:34.386164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502baf5-00b5-449a-bcba-3c4cecfc2d1d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:34.438992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110c2d9-7bc3-4b27-9f5b-52c656aafffd None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:34.449302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:34.451201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:34.451810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:34.452273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:34.464379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:34.470817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:34.471757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:34.472588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:34.475284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 128/262] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:34.476384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:34.516128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:34.516800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:34.517083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:34.517358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/4411f712bb1f4f52899ba488337f2c8f/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:34.519397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a60c137f78554bd7bd0e17ec9005b3d8, user_id=4411f712bb1f4f52899ba488337f2c8f, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:34.520789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:34.524516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:34.593388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6034e-4718-4d57-ae18-9a57cf92787e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:34.599773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:34.606243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 135/263] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:34 2022] PUT /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/4411f712bb1f4f52899ba488337f2c8f/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:34.607341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:34.641154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:34.642804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:34.643976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:34.644266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:34.645481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=a50c7a670a864db1bf9f5611d0cbfd3d) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:34.646640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:34.648399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:34.662308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 129/264] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:34 2022] GET /identity/v3/role_assignments?user.id=a50c7a670a864db1bf9f5611d0cbfd3d&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:34.769011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab68ab-6b17-43dc-8ebb-134f1b0d0eb2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:34.814008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:34.814655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:34.814937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:34.815210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:34.815920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:34.816224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:34.817698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:34.831149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 136/265] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:34.837260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:34.970782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92581b-0328-44b1-8250-baf5526a3590 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:34.972525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:35.008201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:35.008835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:35.009115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:35.009388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] PATH_INFO: `/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:35.010636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] RBAC: Authorizing `identity:get_user(user_id=a50c7a670a864db1bf9f5611d0cbfd3d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:35.014355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:35.016003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 130/266] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:34 2022] GET /identity/v3/users/a50c7a670a864db1bf9f5611d0cbfd3d => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:35.021605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:35.092076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:35.137399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29489d3-ea7e-4431-abf3-b20da7c72f5d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:35.180827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:35.181731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:35.182184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:35.182602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:35.262995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:35.265280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:35.327950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:35.374083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 137/267] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:35.379642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:35.534582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe0e0-1d48-40f0-bf95-556402aca1fa None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:35.589627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62eeb-3c34-4811-8f2b-7107dda929b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:35.590481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62eeb-3c34-4811-8f2b-7107dda929b5 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:35.590907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62eeb-3c34-4811-8f2b-7107dda929b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:35.591951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62eeb-3c34-4811-8f2b-7107dda929b5 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:35.593260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62eeb-3c34-4811-8f2b-7107dda929b5 None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:35.594854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62eeb-3c34-4811-8f2b-7107dda929b5 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:35.597072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 131/268] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:35 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:35.602755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:35.750027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72776-3e0e-43e3-9f5d-9e227eab53ad None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:35.789767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ef01-1f22-44f1-9ca7-f5ad372e78c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:35.790621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ef01-1f22-44f1-9ca7-f5ad372e78c8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:35.791045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ef01-1f22-44f1-9ca7-f5ad372e78c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:35.791485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ef01-1f22-44f1-9ca7-f5ad372e78c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:35.792381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ef01-1f22-44f1-9ca7-f5ad372e78c8 None admin] RBAC: Adding query filter params (role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=a50c7a670a864db1bf9f5611d0cbfd3d) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:35.792907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ef01-1f22-44f1-9ca7-f5ad372e78c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:35.795266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ef01-1f22-44f1-9ca7-f5ad372e78c8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:35.802048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 138/269] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:35 2022] GET /identity/v3/role_assignments?user.id=a50c7a670a864db1bf9f5611d0cbfd3d&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:35.841113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7047e7-5abe-4329-a0b7-1af86c8d397e None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:35.841643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7047e7-5abe-4329-a0b7-1af86c8d397e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:35.842150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7047e7-5abe-4329-a0b7-1af86c8d397e None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:35.843849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 132/270] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:35.855186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef6a3-9641-4ce9-960d-e04f8ebc3cfa None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:35.855746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef6a3-9641-4ce9-960d-e04f8ebc3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:35.856194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef6a3-9641-4ce9-960d-e04f8ebc3cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:35.885719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-dabef6a3-9641-4ce9-960d-e04f8ebc3cfa None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:35.887247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-dabef6a3-9641-4ce9-960d-e04f8ebc3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:35.922114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:35.993614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 139/271] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:36.005358 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa19e-a3fc-44a2-8315-c14f6b31d921 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.005867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa19e-a3fc-44a2-8315-c14f6b31d921 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.006285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa19e-a3fc-44a2-8315-c14f6b31d921 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.008113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 133/272] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:36.014591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2d862-643c-417e-b135-42539e6e0dbd None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.015145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2d862-643c-417e-b135-42539e6e0dbd None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.015634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2d862-643c-417e-b135-42539e6e0dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.036204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b3b2d862-643c-417e-b135-42539e6e0dbd None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:36.037660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b3b2d862-643c-417e-b135-42539e6e0dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:36.091823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d315fb-ef97-4805-afb8-80c531485bf6 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.092334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d315fb-ef97-4805-afb8-80c531485bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.092753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d315fb-ef97-4805-afb8-80c531485bf6 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.094484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 134/273] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:36.100240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3d5d-f7be-410b-a836-ee883fd097b6 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.100769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3d5d-f7be-410b-a836-ee883fd097b6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.101128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f3d5d-f7be-410b-a836-ee883fd097b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.117059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 140/274] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:36.124561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8a8f3d5d-f7be-410b-a836-ee883fd097b6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:36.125927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8a8f3d5d-f7be-410b-a836-ee883fd097b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:36.158519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:36.203726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 135/275] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:36.283005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2d862-643c-417e-b135-42539e6e0dbd None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.375699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:36.391029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2d862-643c-417e-b135-42539e6e0dbd None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:36.415665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f3d5d-f7be-410b-a836-ee883fd097b6 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.431278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:36.431278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.431278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.431278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.443298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:36.446925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:36.447843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:36.448641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 141/276] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:36.454668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.549456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f3d5d-f7be-410b-a836-ee883fd097b6 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:36.569828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4bd3c-da71-4a92-b63e-1e49059f919c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:36.585126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:36.585755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.586034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.586318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.597396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:36.602225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:36.603107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:36.603947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 136/277] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:36.604605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.613534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:36.614148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.614430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.614711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.615383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:36.615720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:36.617084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:36.626127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 142/278] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:36.626725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.639792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:36.642870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:36.714144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fab48-d6c0-46e9-8db9-3e267300d638 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:36.735301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd50a3-0ec0-442f-8d26-2f3672107b7c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:36.748797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:36.749433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.749718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.749991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.751106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:36.752635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:36.754201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 137/279] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:36.755659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.773742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:36.774355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.774639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.774914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.775679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:36.775984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:36.777356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:36.790795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 143/280] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:36.790795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.860893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:36.866666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f62e6f-d281-4f9b-8ba7-8a555683f4b5 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:36.870540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:36.903050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:36.904233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.904559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.904781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] PATH_INFO: `/v3/users/c7d15e5a788c4534886d95cb35e6e8a8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.910482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee473e9-7916-4bd3-a6be-6842b7048ac3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:36.925808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] RBAC: Authorizing `identity:get_user(user_id=c7d15e5a788c4534886d95cb35e6e8a8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:36.927447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:36.929140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 138/281] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:36 2022] GET /identity/v3/users/c7d15e5a788c4534886d95cb35e6e8a8 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:36.934629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:36.948576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:36.949187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:36.949470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:36.949742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:36.950425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:36.952119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:37.037320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10115ac3-6174-4b35-a91b-acffddf7bf38 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:37.049655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 144/282] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:29:36 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:37.049655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:37.084453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:37.085104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:37.085451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:37.085727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] PATH_INFO: `/v3/users/41a82bba298b40418e91f27acba63939` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:37.086977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] RBAC: Authorizing `identity:get_user(user_id=41a82bba298b40418e91f27acba63939)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:37.088643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:37.090593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 139/283] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:36 2022] GET /identity/v3/users/41a82bba298b40418e91f27acba63939 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:37.100774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:37.147463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:37.197705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f1d3-1a62-4507-8ac9-e81f08e0655d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:37.235177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:37.252086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:37.252679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:37.253167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:37.253537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:37.254504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, user.id=c7d15e5a788c4534886d95cb35e6e8a8, scope.system=all) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:37.255870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:37.256922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:37.265428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b41e1-5e6b-462c-9432-4908ba6cf72c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:37.268198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 145/284] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 28 08:29:37 2022] GET /identity/v3/role_assignments?user.id=c7d15e5a788c4534886d95cb35e6e8a8&scope.system=all&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:37.312192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68be8dc-c598-44f9-98d7-c496c7fb780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:37.312841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68be8dc-c598-44f9-98d7-c496c7fb780f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:37.313118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68be8dc-c598-44f9-98d7-c496c7fb780f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:37.313391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68be8dc-c598-44f9-98d7-c496c7fb780f None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:37.314573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68be8dc-c598-44f9-98d7-c496c7fb780f None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:37.316114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68be8dc-c598-44f9-98d7-c496c7fb780f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:37.318600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 140/285] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:37 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:37.323963 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:37.365889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0b6b-ac32-43f5-81ef-e4d43d48d717 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:37.366522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0b6b-ac32-43f5-81ef-e4d43d48d717 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:37.366955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0b6b-ac32-43f5-81ef-e4d43d48d717 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:37.369577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 141/286] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:37.376062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eddf4-73ea-47ef-b5c8-fb2e7a4543a0 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:37.376359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eddf4-73ea-47ef-b5c8-fb2e7a4543a0 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:37.376612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eddf4-73ea-47ef-b5c8-fb2e7a4543a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:37.406860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-df0eddf4-73ea-47ef-b5c8-fb2e7a4543a0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:37.408739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-df0eddf4-73ea-47ef-b5c8-fb2e7a4543a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:37.473015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb05334-72be-4f10-8998-af8904675092 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:37.509975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 142/287] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:37.515893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:37.516561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:37.516840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:37.517116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/41a82bba298b40418e91f27acba63939/roles/81df27a3458948d98f5562812ed7280e` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:37.519051 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] RBAC: Authorizing `identity:create_grant(project_id=a60c137f78554bd7bd0e17ec9005b3d8, user_id=41a82bba298b40418e91f27acba63939, role_id=81df27a3458948d98f5562812ed7280e)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:37.520537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:37.630169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 146/288] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:29:37 2022] PUT /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/users/41a82bba298b40418e91f27acba63939/roles/81df27a3458948d98f5562812ed7280e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:37.811851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eddf4-73ea-47ef-b5c8-fb2e7a4543a0 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:37.839866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:37.950079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eddf4-73ea-47ef-b5c8-fb2e7a4543a0 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:37.998397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:37.999781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:38.000301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:38.000794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:38.013536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:38.018836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:38.019784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:38.020583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:38.023214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 143/289] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:38.028876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:38.104159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:38.171035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f11a6-e48e-48e2-bcac-4488bd792c7e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:38.214996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:38.216653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:38.217260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:38.217752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:38.218625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:38.219128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:38.220803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:38.233981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 147/290] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:38.239613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:38.346052 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:38.368344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab54a9-3016-458e-88b2-baf3b934a6be None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:38.418863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:38.420120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:38.420451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:38.420763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] PATH_INFO: `/v3/users/4411f712bb1f4f52899ba488337f2c8f` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:38.426636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=4411f712bb1f4f52899ba488337f2c8f)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:38.428209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:38.429964 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 144/291] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:38 2022] GET /identity/v3/users/4411f712bb1f4f52899ba488337f2c8f => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:38.436124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:38.563225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde63ae-2a93-423b-b355-8624b2447b39 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:38.578326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:38.610495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:38.611142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:38.611443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:38.611726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:38.688350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:38.689749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:38.796325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 148/292] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:38.801654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:38.942232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c191dc2-923b-41b9-a5e4-ac72ae8efaf2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:38.993225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa5405-398f-4ecb-8bdc-dd34175f68ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:38.993861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5405-398f-4ecb-8bdc-dd34175f68ed None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:38.994144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5405-398f-4ecb-8bdc-dd34175f68ed None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:38.994419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5405-398f-4ecb-8bdc-dd34175f68ed None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:38.995584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa5405-398f-4ecb-8bdc-dd34175f68ed None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:38.997037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa5405-398f-4ecb-8bdc-dd34175f68ed None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:38.999394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 145/293] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:38 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:39.005212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:39.026855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:39.134285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57f4e3-6db2-4a0f-9001-2259ee43fda6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:39.173014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48747c28-b1d8-40ae-8af5-c9d096a71c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:39.173632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747c28-b1d8-40ae-8af5-c9d096a71c6e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:39.173962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747c28-b1d8-40ae-8af5-c9d096a71c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:39.174243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48747c28-b1d8-40ae-8af5-c9d096a71c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:39.174974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48747c28-b1d8-40ae-8af5-c9d096a71c6e None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=4411f712bb1f4f52899ba488337f2c8f) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:39.175283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48747c28-b1d8-40ae-8af5-c9d096a71c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:39.176738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48747c28-b1d8-40ae-8af5-c9d096a71c6e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:39.182626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 149/294] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:39 2022] GET /identity/v3/role_assignments?user.id=4411f712bb1f4f52899ba488337f2c8f&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:39.832541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94932ceb-24bd-4fe1-aa6d-eaa02d76e27f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:39.833048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94932ceb-24bd-4fe1-aa6d-eaa02d76e27f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:39.833048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94932ceb-24bd-4fe1-aa6d-eaa02d76e27f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:39.834395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 146/295] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:39.839308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50574af4-21c5-48f7-baa7-9c9cdc0efda0 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:39.839714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50574af4-21c5-48f7-baa7-9c9cdc0efda0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:39.839899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50574af4-21c5-48f7-baa7-9c9cdc0efda0 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:39.842720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bb96-c2d5-41c9-8bdb-bdca9aa16802 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:39.843010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bb96-c2d5-41c9-8bdb-bdca9aa16802 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:39.843287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bb96-c2d5-41c9-8bdb-bdca9aa16802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:39.846295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 150/296] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:39.851909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e66c4-b7cd-4cad-ad6a-cddbbc3ca576 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:39.852199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e66c4-b7cd-4cad-ad6a-cddbbc3ca576 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:39.852480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e66c4-b7cd-4cad-ad6a-cddbbc3ca576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:39.868370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0259bb96-c2d5-41c9-8bdb-bdca9aa16802 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:39.869555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0259bb96-c2d5-41c9-8bdb-bdca9aa16802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:39.872861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-187e66c4-b7cd-4cad-ad6a-cddbbc3ca576 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:39.874275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-187e66c4-b7cd-4cad-ad6a-cddbbc3ca576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:39.887606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:39.958161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 147/297] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:39.960280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 151/298] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:40.106151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14397f-766b-42a1-9896-f9c798ab6c93 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.107334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14397f-766b-42a1-9896-f9c798ab6c93 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.107855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14397f-766b-42a1-9896-f9c798ab6c93 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.109776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 148/299] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:40.115164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17374b-90b4-4344-ba92-6fc705a4ffa4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.115723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17374b-90b4-4344-ba92-6fc705a4ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.116205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17374b-90b4-4344-ba92-6fc705a4ffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.130018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:40.135595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-bc17374b-90b4-4344-ba92-6fc705a4ffa4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:40.136780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bc17374b-90b4-4344-ba92-6fc705a4ffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:40.214555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 152/300] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:40.228929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14397f-766b-42a1-9896-f9c798ab6c93 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.255006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17374b-90b4-4344-ba92-6fc705a4ffa4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.342016 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14397f-766b-42a1-9896-f9c798ab6c93 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.364430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17374b-90b4-4344-ba92-6fc705a4ffa4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.379181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.380220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.380693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.381199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.393393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:40.398843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:40.399760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:40.400551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:40.401643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.402149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.402434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.402715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.409045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 149/301] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:40.409674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:40.411373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.414893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:40.420318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:40.426750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:40.427614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 153/302] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:40.428274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:40.428806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.525549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac700eee-7700-4681-b096-d8cd7170c0e6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.535351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5199aa-2e0c-4e37-a19b-15efc8e018b6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.562927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.563995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.564510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.564878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.565545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:40.565952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:40.567512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:40.571752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.572387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.572672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.572947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.574261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] RBAC: Adding query filter params (name=member) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:40.574631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:40.576754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:40.577841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 150/303] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:40.583497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.586817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 154/304] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:40.588382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.652273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:40.658039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:40.693669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd3d7-d8c3-4be8-a646-53bd0a425549 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.697681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef56315-4083-4680-8b09-6dfa295e7329 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.728472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.729102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.729386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.729675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.730751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:40.731193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082510b-d35d-4e8d-bf7e-0fadba4031c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.732139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082510b-d35d-4e8d-bf7e-0fadba4031c7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.732139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082510b-d35d-4e8d-bf7e-0fadba4031c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.732362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:40.732445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082510b-d35d-4e8d-bf7e-0fadba4031c7 None admin] PATH_INFO: `/v3/users/a8efc7d9b86740b69f954c08cc2bcfaf` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.733911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 151/305] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:40.734665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.746497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082510b-d35d-4e8d-bf7e-0fadba4031c7 None admin] RBAC: Authorizing `identity:get_user(user_id=a8efc7d9b86740b69f954c08cc2bcfaf)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:40.748680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082510b-d35d-4e8d-bf7e-0fadba4031c7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:40.750408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 155/306] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/users/a8efc7d9b86740b69f954c08cc2bcfaf => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:40.751622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc81f1-2945-4569-9764-15130cf65220 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.751914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc81f1-2945-4569-9764-15130cf65220 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.752385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc81f1-2945-4569-9764-15130cf65220 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.753584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 156/307] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:40.754267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc81f1-2945-4569-9764-15130cf65220 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.845453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f14f-53b0-44c9-ab43-2d04656213ea None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.853285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc81f1-2945-4569-9764-15130cf65220 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:40.869592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:40.879137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.879793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.880070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.880737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] PATH_INFO: `/v3/users/c7d15e5a788c4534886d95cb35e6e8a8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.881449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] RBAC: Authorizing `identity:get_user(user_id=c7d15e5a788c4534886d95cb35e6e8a8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:40.882874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:40.884461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 152/308] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/users/c7d15e5a788c4534886d95cb35e6e8a8 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:40.885212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:40.887239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:40.887909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:40.888445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:40.888730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] PATH_INFO: `/v3/groups` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:40.889353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:40.890143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:40.890765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:40.980887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e148715-8788-4b3d-b7d3-16e306ff09a1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:41.012400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c478528-7191-419c-983e-916fd35aee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:41.013990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478528-7191-419c-983e-916fd35aee9a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:41.014263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478528-7191-419c-983e-916fd35aee9a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:41.014540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478528-7191-419c-983e-916fd35aee9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:41.015258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478528-7191-419c-983e-916fd35aee9a None admin] RBAC: Adding query filter params (role.id=81df27a3458948d98f5562812ed7280e, user.id=a8efc7d9b86740b69f954c08cc2bcfaf, scope.system=all) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:41.015597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478528-7191-419c-983e-916fd35aee9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:41.017026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478528-7191-419c-983e-916fd35aee9a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:41.021813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 153/309] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 28 08:29:40 2022] GET /identity/v3/role_assignments?user.id=a8efc7d9b86740b69f954c08cc2bcfaf&scope.system=all&role.id=81df27a3458948d98f5562812ed7280e => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:41.022943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b23b-b5bf-43b0-92e4-23881f93ba19 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:41.023226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b23b-b5bf-43b0-92e4-23881f93ba19 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:41.023531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b23b-b5bf-43b0-92e4-23881f93ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:41.040972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 157/310] 10.222.0.57 () {60 vars in 1134 bytes} [Wed Sep 28 08:29:40 2022] POST /identity/v3/groups => generated 229 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:29:41.047924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:41.052885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-6202b23b-b5bf-43b0-92e4-23881f93ba19 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:41.054295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6202b23b-b5bf-43b0-92e4-23881f93ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:41.131248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:41.137393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 154/311] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:41.187105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49560d-5769-4eb9-80ab-2f640f71dd2f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:41.230354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:41.230946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:41.231221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:41.231586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] PATH_INFO: `/v3/system/users/c7d15e5a788c4534886d95cb35e6e8a8/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:41.233738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c7d15e5a788c4534886d95cb35e6e8a8, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:41.235234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:41.304028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 158/312] 10.222.0.57 () {58 vars in 1334 bytes} [Wed Sep 28 08:29:41 2022] PUT /identity/v3/system/users/c7d15e5a788c4534886d95cb35e6e8a8/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:41.446093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b23b-b5bf-43b0-92e4-23881f93ba19 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:41.562250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b23b-b5bf-43b0-92e4-23881f93ba19 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:41.599341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:41.600002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:41.600283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:41.600558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:41.612566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:41.617452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:41.618333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:41.619155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 155/313] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:41.625939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:41.674069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:41.735087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c95fd-34e9-4525-984b-b664be19808a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:41.769821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:41.771484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:41.772479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:41.772765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:41.773457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:41.773766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:41.775145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:41.784292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 159/314] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:41.789750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:41.860424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:41.905454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955cf12-0b70-4027-a77c-70c9fda0d31d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:41.945155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:41.945790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:41.946074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:41.946348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] PATH_INFO: `/v3/users/41a82bba298b40418e91f27acba63939` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:41.947522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] RBAC: Authorizing `identity:get_user(user_id=41a82bba298b40418e91f27acba63939)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:41.948968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:41.951458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 156/315] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:41 2022] GET /identity/v3/users/41a82bba298b40418e91f27acba63939 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:41.956796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:42.064042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f9137-a89f-47cf-bb26-7fd145d6c5ec None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:42.065716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:42.101007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75414-9679-4a82-9154-345893760212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:42.101620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75414-9679-4a82-9154-345893760212 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:42.101904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75414-9679-4a82-9154-345893760212 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:42.102174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f75414-9679-4a82-9154-345893760212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:42.170043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f75414-9679-4a82-9154-345893760212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:42.171432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f75414-9679-4a82-9154-345893760212 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:42.270877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 160/316] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:42.276294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:42.389321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539c5e2-0c5d-4e49-a36d-b6f1b9130099 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:42.416491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:42.425693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34440e52-d5c8-4764-9559-ab7abfa1080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:42.426357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34440e52-d5c8-4764-9559-ab7abfa1080e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:42.426638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34440e52-d5c8-4764-9559-ab7abfa1080e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:42.426962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34440e52-d5c8-4764-9559-ab7abfa1080e None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:42.428293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34440e52-d5c8-4764-9559-ab7abfa1080e None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:42.439542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34440e52-d5c8-4764-9559-ab7abfa1080e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:42.439542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 157/317] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:42 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:42.439726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75414-9679-4a82-9154-345893760212 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:42.448582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:42.539462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f75414-9679-4a82-9154-345893760212 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:42.572884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f732c68-a41f-4473-b2a7-7a0b95bb6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:42.573490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f732c68-a41f-4473-b2a7-7a0b95bb6c91 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:42.573762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f732c68-a41f-4473-b2a7-7a0b95bb6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:42.574042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f732c68-a41f-4473-b2a7-7a0b95bb6c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:42.574767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f732c68-a41f-4473-b2a7-7a0b95bb6c91 None admin] RBAC: Adding query filter params (role.id=81df27a3458948d98f5562812ed7280e, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8, user.id=41a82bba298b40418e91f27acba63939) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:42.575075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f732c68-a41f-4473-b2a7-7a0b95bb6c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:42.577228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f732c68-a41f-4473-b2a7-7a0b95bb6c91 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:42.583686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 161/318] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:29:42 2022] GET /identity/v3/role_assignments?user.id=41a82bba298b40418e91f27acba63939&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=81df27a3458948d98f5562812ed7280e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:43.239037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273e70-d1ae-4c3d-9ad5-99889fcd7137 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.239546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273e70-d1ae-4c3d-9ad5-99889fcd7137 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.239546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273e70-d1ae-4c3d-9ad5-99889fcd7137 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.240912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 158/319] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:43.248914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba18f4-26ee-46fc-a350-8e8f55377ff0 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.249415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba18f4-26ee-46fc-a350-8e8f55377ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.250239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba18f4-26ee-46fc-a350-8e8f55377ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.268632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-16ba18f4-26ee-46fc-a350-8e8f55377ff0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:43.269810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-16ba18f4-26ee-46fc-a350-8e8f55377ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:43.336198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:43.345156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 162/320] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:43.401196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad831-94e0-4aac-8144-f4d1b55fe417 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.401532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad831-94e0-4aac-8144-f4d1b55fe417 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.401741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad831-94e0-4aac-8144-f4d1b55fe417 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.403217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 159/321] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:43.408868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519f0f9-0d1a-4347-bb0f-c58f27f0b33d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.409159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519f0f9-0d1a-4347-bb0f-c58f27f0b33d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.409440 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519f0f9-0d1a-4347-bb0f-c58f27f0b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.428329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1519f0f9-0d1a-4347-bb0f-c58f27f0b33d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:43.429550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1519f0f9-0d1a-4347-bb0f-c58f27f0b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:43.501995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 163/322] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:43.597418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076493d-8dd8-4d0a-a18c-b8709a6822e4 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.597726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076493d-8dd8-4d0a-a18c-b8709a6822e4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.597967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076493d-8dd8-4d0a-a18c-b8709a6822e4 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.599457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 160/323] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:43.604464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392784-b2cb-4de9-8cc6-cddf0c9571d8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.604750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392784-b2cb-4de9-8cc6-cddf0c9571d8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.605021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce392784-b2cb-4de9-8cc6-cddf0c9571d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.624573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ce392784-b2cb-4de9-8cc6-cddf0c9571d8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:43.625740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ce392784-b2cb-4de9-8cc6-cddf0c9571d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:43.631005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076493d-8dd8-4d0a-a18c-b8709a6822e4 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:43.697689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 164/324] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:43.737156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076493d-8dd8-4d0a-a18c-b8709a6822e4 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:43.773161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:43.773797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.774077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.774357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.776441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce392784-b2cb-4de9-8cc6-cddf0c9571d8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:43.786373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:43.791383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:43.792330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:43.793164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 161/325] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:43.799525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:43.839085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:43.863503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:43.887917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce392784-b2cb-4de9-8cc6-cddf0c9571d8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:43.913653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da158f6-bd57-4121-836c-d7e01f04bc03 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:43.936179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:43.936818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.937099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.937575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.938488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:43.939950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:43.941684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 165/326] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:29:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:43.946859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:43.948001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:43.948602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:43.948880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:43.949151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:43.949866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:43.950208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:43.951669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:43.965145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 162/327] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:43.968028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:44.054475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53fd3d-58a0-46b5-9263-1e6d8f0ec0ae None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:44.066514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad08f6-5ea2-4d20-9aba-df9634f14dc9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:44.078211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:44.082057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:44.088427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:44.089028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:44.089318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:44.089591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] PATH_INFO: `/v3/groups` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:44.090219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:44.091667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:44.099467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:44.100089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:44.100376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:44.100640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] PATH_INFO: `/v3/users/a8efc7d9b86740b69f954c08cc2bcfaf` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:44.101792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] RBAC: Authorizing `identity:get_user(user_id=a8efc7d9b86740b69f954c08cc2bcfaf)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:44.103231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:44.104829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 163/328] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:43 2022] GET /identity/v3/users/a8efc7d9b86740b69f954c08cc2bcfaf => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:44.105573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:44.200893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933269c-545e-4ea5-b073-fc72e9e5e852 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:44.217234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 166/329] 10.222.0.57 () {60 vars in 1134 bytes} [Wed Sep 28 08:29:43 2022] POST /identity/v3/groups => generated 226 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:29:44.218024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:44.236757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:44.237414 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:44.237689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:44.237953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:44.250886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:44.256497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:44.257687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:44.258488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 164/330] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:44.264619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:44.316420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:44.364260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d839de-832e-4b91-9192-0489a3d8e704 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:44.378800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1911e-f80c-48b9-9865-da0a7c897642 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:44.402075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:44.403004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:44.403806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:44.404585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] PATH_INFO: `/v3/system/users/a8efc7d9b86740b69f954c08cc2bcfaf/roles/81df27a3458948d98f5562812ed7280e` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:44.405714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a8efc7d9b86740b69f954c08cc2bcfaf, role_id=81df27a3458948d98f5562812ed7280e)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:44.407084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:44.416634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:44.417243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:44.418302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:44.418302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:44.418544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:44.418784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:44.420817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:44.429035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 165/331] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:44.434876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:44.475938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 167/332] 10.222.0.57 () {58 vars in 1334 bytes} [Wed Sep 28 08:29:44 2022] PUT /identity/v3/system/users/a8efc7d9b86740b69f954c08cc2bcfaf/roles/81df27a3458948d98f5562812ed7280e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:44.548975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e57ee9-078e-4d2b-817c-c83f8f83a1a0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:44.558096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:44.590451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413de792-f696-4f7f-b6bc-d1954a392ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:44.591955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de792-f696-4f7f-b6bc-d1954a392ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:44.592302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de792-f696-4f7f-b6bc-d1954a392ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:44.592642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413de792-f696-4f7f-b6bc-d1954a392ac4 None admin] PATH_INFO: `/v3/users/c7d15e5a788c4534886d95cb35e6e8a8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:44.593932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413de792-f696-4f7f-b6bc-d1954a392ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=c7d15e5a788c4534886d95cb35e6e8a8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:44.595496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413de792-f696-4f7f-b6bc-d1954a392ac4 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:44.597520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 166/333] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:44 2022] GET /identity/v3/users/c7d15e5a788c4534886d95cb35e6e8a8 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:44.603345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:44.668042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:44.723820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07561-2994-4645-8a29-3094f3032e6e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:44.767043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b19f17-ffdf-4af3-8822-6e72923cfc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:44.767849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19f17-ffdf-4af3-8822-6e72923cfc9f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:44.768246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19f17-ffdf-4af3-8822-6e72923cfc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:44.768629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b19f17-ffdf-4af3-8822-6e72923cfc9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:44.769494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b19f17-ffdf-4af3-8822-6e72923cfc9f None admin] RBAC: Adding query filter params (role.id=23ec368052424f10b0ffccb344cf6b5c, user.id=c7d15e5a788c4534886d95cb35e6e8a8, scope.system=all) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:44.769898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b19f17-ffdf-4af3-8822-6e72923cfc9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:44.771413 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b19f17-ffdf-4af3-8822-6e72923cfc9f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:44.784818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 168/334] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 28 08:29:44 2022] GET /identity/v3/role_assignments?user.id=c7d15e5a788c4534886d95cb35e6e8a8&scope.system=all&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:46.815560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96abbe-48c0-4ba3-a69c-d4cb971e02ec None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:46.816069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96abbe-48c0-4ba3-a69c-d4cb971e02ec None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:46.816175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96abbe-48c0-4ba3-a69c-d4cb971e02ec None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:46.818114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 167/335] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:46.823622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85985-4232-4e97-8a51-346786b43deb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:46.824140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85985-4232-4e97-8a51-346786b43deb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:46.824307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85985-4232-4e97-8a51-346786b43deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:46.853333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c0a85985-4232-4e97-8a51-346786b43deb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:46.854546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c0a85985-4232-4e97-8a51-346786b43deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:46.929759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 169/336] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:46.972402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e70ba-acef-4e45-bc05-3dd99329b000 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:46.972730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e70ba-acef-4e45-bc05-3dd99329b000 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:46.972944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e70ba-acef-4e45-bc05-3dd99329b000 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:46.974547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 168/337] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:46.979791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423879-7344-4088-a2a9-fe66df3fe52c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:46.980076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423879-7344-4088-a2a9-fe66df3fe52c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:46.980346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423879-7344-4088-a2a9-fe66df3fe52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:47.002269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7a423879-7344-4088-a2a9-fe66df3fe52c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:47.003475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7a423879-7344-4088-a2a9-fe66df3fe52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:47.036809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:47.076721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 170/338] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:47.410664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e70ba-acef-4e45-bc05-3dd99329b000 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:47.547084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423879-7344-4088-a2a9-fe66df3fe52c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:47.547270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e70ba-acef-4e45-bc05-3dd99329b000 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:47.591255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f703d2-4fd4-4441-b252-2650972b1ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:47.592122 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f703d2-4fd4-4441-b252-2650972b1ebe None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:47.592517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f703d2-4fd4-4441-b252-2650972b1ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:47.592800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f703d2-4fd4-4441-b252-2650972b1ebe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:47.609257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f703d2-4fd4-4441-b252-2650972b1ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-61f703d2-4fd4-4441-b252-2650972b1ebe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:47.614426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:47.615327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:47.616176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 169/339] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:47.617375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60c30-4b99-479a-94d8-b91d3e22cd94 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:47.617547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60c30-4b99-479a-94d8-b91d3e22cd94 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:47.620450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60c30-4b99-479a-94d8-b91d3e22cd94 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:47.622194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 170/340] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:47.622794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60c30-4b99-479a-94d8-b91d3e22cd94 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:47.717072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:47.755055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423879-7344-4088-a2a9-fe66df3fe52c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:47.837243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe881d8-6a8b-4fea-aabe-0e07848935c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:47.838118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe881d8-6a8b-4fea-aabe-0e07848935c5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:47.838395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe881d8-6a8b-4fea-aabe-0e07848935c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:47.839678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe881d8-6a8b-4fea-aabe-0e07848935c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:47.852506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60c30-4b99-479a-94d8-b91d3e22cd94 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:47.864784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe881d8-6a8b-4fea-aabe-0e07848935c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-ebe881d8-6a8b-4fea-aabe-0e07848935c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:47.871692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:47.873184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:47.873974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:47.878526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 171/341] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:47.880565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3291f0-0d66-46fc-bc6e-9f2091028e62 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:47.880852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3291f0-0d66-46fc-bc6e-9f2091028e62 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:47.881130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3291f0-0d66-46fc-bc6e-9f2091028e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:47.919889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:47.920518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:47.920794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:47.921064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:47.921748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:47.922829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1a3291f0-0d66-46fc-bc6e-9f2091028e62 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:47.924216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1a3291f0-0d66-46fc-bc6e-9f2091028e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:47.928245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:47.928245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:47.944958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 171/342] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:47.945979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:47.968573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:48.020986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 172/343] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:48.021968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3291f0-0d66-46fc-bc6e-9f2091028e62 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:48.097666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:48.108060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010feb-1bbf-4d1b-bdd6-dbbdc688349e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:48.155195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656618d9-507a-42cd-a6ed-f4d78bc74eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:48.156244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656618d9-507a-42cd-a6ed-f4d78bc74eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:48.156669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656618d9-507a-42cd-a6ed-f4d78bc74eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:48.157139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656618d9-507a-42cd-a6ed-f4d78bc74eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:48.157950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656618d9-507a-42cd-a6ed-f4d78bc74eb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:48.159928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656618d9-507a-42cd-a6ed-f4d78bc74eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:48.162177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656618d9-507a-42cd-a6ed-f4d78bc74eb7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:48.172804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 172/344] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:48.175195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ae89-7ab2-4634-9b63-555be2146056 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:48.175689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ae89-7ab2-4634-9b63-555be2146056 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:48.176139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ae89-7ab2-4634-9b63-555be2146056 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:48.177876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 173/345] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:48.184708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8dfd4-4305-44ee-b9ea-f7548cb56f59 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:48.185685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8dfd4-4305-44ee-b9ea-f7548cb56f59 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:48.186140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8dfd4-4305-44ee-b9ea-f7548cb56f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:48.211821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d5e8dfd4-4305-44ee-b9ea-f7548cb56f59 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:48.213478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d5e8dfd4-4305-44ee-b9ea-f7548cb56f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:48.250652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3291f0-0d66-46fc-bc6e-9f2091028e62 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:48.315080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:48.316158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:48.317341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:48.318411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] PATH_INFO: `/v3/users/a8efc7d9b86740b69f954c08cc2bcfaf` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:48.320902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] RBAC: Authorizing `identity:get_user(user_id=a8efc7d9b86740b69f954c08cc2bcfaf)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:48.322812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:48.328242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 173/346] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:29:48 2022] GET /identity/v3/users/a8efc7d9b86740b69f954c08cc2bcfaf => generated 293 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:48.329832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:48.332165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 174/347] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:48.334831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8dfd4-4305-44ee-b9ea-f7548cb56f59 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:48.386730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:48.476034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:48.501022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8dfd4-4305-44ee-b9ea-f7548cb56f59 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:48.533054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6dc86-7145-49c9-a0f6-ace0c0d472e1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:48.560138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:48.561237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:48.562413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:48.563003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:48.565000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] RBAC: Adding query filter params (role.id=81df27a3458948d98f5562812ed7280e, user.id=a8efc7d9b86740b69f954c08cc2bcfaf, scope.system=all) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:48.565753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:48.568184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:48.596212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 175/348] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 28 08:29:48 2022] GET /identity/v3/role_assignments?user.id=a8efc7d9b86740b69f954c08cc2bcfaf&scope.system=all&role.id=81df27a3458948d98f5562812ed7280e => generated 510 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:48.597769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:48.600228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:48.601113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:48.601574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:48.602423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:48.721543 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:48.723044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:48.767161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:48.795210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3011393-7977-4aa3-aa54-34f6df15b57b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:48.849499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:48.850153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:48.850460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:48.850739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:48.877116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:48.882705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:48.883683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:48.884555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:48.891795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 176/349] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:48.892719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:48.910019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:48.931192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 174/350] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:48.932283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.052789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46031-63a6-423f-b6ff-1c064fe274ea None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:49.081767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b4e64-eb38-40ce-9880-1cc858d6d6b4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:49.100589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:49.101226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.101502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.101833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.116569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:49.118514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:49.127933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:49.134585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 177/351] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:49.135390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.136150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:49.136150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.136150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.136150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.136400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:49.136400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:49.137099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:49.151684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 175/352] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:49.156802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.236965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:49.280066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5d296-63c2-4132-af84-9533b5d2fa3e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:49.288966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbe11c-5c96-4c2e-877f-2577788f8233 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:49.322276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:49.322825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.323100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.323369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.324554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:49.326525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:49.329187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 178/353] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:49 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:49.329905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.331596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfefe-a475-4df5-9a77-c4c9b7357660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:49.332315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfefe-a475-4df5-9a77-c4c9b7357660 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.332791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfefe-a475-4df5-9a77-c4c9b7357660 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.333104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfefe-a475-4df5-9a77-c4c9b7357660 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.334458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfefe-a475-4df5-9a77-c4c9b7357660 None admin] RBAC: Adding query filter params (name=member) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:49.334458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfefe-a475-4df5-9a77-c4c9b7357660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:49.335875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfefe-a475-4df5-9a77-c4c9b7357660 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:49.348629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 176/354] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:49.350785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b773d7-afd9-44db-b326-d1d5968acf29 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.357328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b773d7-afd9-44db-b326-d1d5968acf29 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.357328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b773d7-afd9-44db-b326-d1d5968acf29 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.357328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 177/355] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:49.360723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b773d7-afd9-44db-b326-d1d5968acf29 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.436067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:49.483205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ddbc4-d86c-467b-a07e-4a83bf5bab11 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:49.503119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b773d7-afd9-44db-b326-d1d5968acf29 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:49.526585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e4cc8-a936-446e-a64e-9ef6aefc7745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:49.527220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e4cc8-a936-446e-a64e-9ef6aefc7745 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.527513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e4cc8-a936-446e-a64e-9ef6aefc7745 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.527787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e4cc8-a936-446e-a64e-9ef6aefc7745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.531230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:49.543500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:49.544690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.544968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.545242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.551954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:49.553561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:49.555410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 178/356] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:49 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:49.556049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.618698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e4cc8-a936-446e-a64e-9ef6aefc7745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:49.619872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e4cc8-a936-446e-a64e-9ef6aefc7745 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:49.679305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c3d9a-5c60-4777-906e-489e4984109f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:49.695029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:49.719910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:49.720524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.720808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.721079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.740017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 179/357] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:49.742243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641aa4f-7897-424e-89a0-8229759a487b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.742243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641aa4f-7897-424e-89a0-8229759a487b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.742243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641aa4f-7897-424e-89a0-8229759a487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.761080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-5641aa4f-7897-424e-89a0-8229759a487b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:49.762273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5641aa4f-7897-424e-89a0-8229759a487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:49.792834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:49.805361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:49.807157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:49.846418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 180/358] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:49.847933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e4de-2baf-454a-9760-4de8b69151e9 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:49.848362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e4de-2baf-454a-9760-4de8b69151e9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:49.848640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622e4de-2baf-454a-9760-4de8b69151e9 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:49.850046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 181/359] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:49.850594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622e4de-2baf-454a-9760-4de8b69151e9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.934982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 179/360] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:49.937072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:49.955493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:49.978754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622e4de-2baf-454a-9760-4de8b69151e9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.033386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d2979-bb54-4dba-a541-7be53e18ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.034406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d2979-bb54-4dba-a541-7be53e18ba92 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.034834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d2979-bb54-4dba-a541-7be53e18ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.035265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d2979-bb54-4dba-a541-7be53e18ba92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.036178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d2979-bb54-4dba-a541-7be53e18ba92 None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=863360da8758425aa2e288263bd6db49) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:50.036633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d2979-bb54-4dba-a541-7be53e18ba92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.038344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d2979-bb54-4dba-a541-7be53e18ba92 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.044752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 182/361] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:29:49 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.046285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b7504-397b-480b-a1ef-167d607f9e6d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.046779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b7504-397b-480b-a1ef-167d607f9e6d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.047234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b7504-397b-480b-a1ef-167d607f9e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.072112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270739b-34bf-41c6-af6f-3e335ce1e5a7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.072304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-cb9b7504-397b-480b-a1ef-167d607f9e6d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:50.072304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cb9b7504-397b-480b-a1ef-167d607f9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:50.108360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:50.128255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.128985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.129270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.129544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.130779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.132279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.134336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 180/362] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:49 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.135149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.178434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 183/363] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:50.179397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b7504-397b-480b-a1ef-167d607f9e6d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.249988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:50.276452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b66a-1cd2-4abf-9380-0cb1350f35e3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.292366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b7504-397b-480b-a1ef-167d607f9e6d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.319392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.320607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.321273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.321688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.323457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.326085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.328094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 181/364] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.329014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.333888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.334547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.334829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.335101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.336315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.337753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.339648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 184/365] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.340387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.371050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:50.448832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfa653-da68-4d85-880c-7c934cb2bf74 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.449566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd8f2a-432d-439a-a0f4-099cd63f1dc9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.487665 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.488562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.489068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.489429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.489658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.490108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.490390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.490682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.491792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.493453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.495411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 185/366] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.496299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.502064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:50.507608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:50.512139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 182/367] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:50.514619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.526701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:50.625051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:50.632553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55d9d9-ee3d-41fe-af18-7dc23e43fd69 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.647882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f825-047b-4217-9bce-b685ff88fac2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.685062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.686556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.686556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.686556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.686980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=863360da8758425aa2e288263bd6db49) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:50.688733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.688842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.694953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 186/368] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.695777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.709470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.710188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.710450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.710738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.733193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:50.742984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:50.743988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:50.744775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:50.748083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 183/369] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:50.749644 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.829200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbf276-5586-4270-8221-ee1e825e178c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.855471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:50.872659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.873895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.874041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.874523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.875523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:50.875935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.877528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.885209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 187/370] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.886260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:50.905815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6cee9-7d17-4663-9e41-9aa5b5e531dc None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:50.924377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:50.963941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:50.964743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:50.966157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:50.966435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:50.967125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:50.967457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:50.969252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:50.980332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 184/371] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:50.987309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:51.025337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee575d-f72b-42e7-aeec-a044e0fd9083 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:51.064468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:51.065509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:51.065985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:51.066472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:51.067366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:51.067923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:51.069527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:51.080303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 188/372] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:51.088627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:51.123942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d204-6a45-48c0-ad6a-8bbc1c5b1820 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:51.161764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:51.169352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:51.170095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:51.170382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:51.170655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:51.220172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:51.238035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639da150-e79c-4b09-acd2-8f0a3c5eaf34 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:51.260141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:51.261594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:51.280602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:51.281564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:51.282078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:51.282582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:51.360529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:51.362278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:51.381852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 185/373] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:51.388369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:51.421705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:51.459941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:51.479310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 189/374] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:51.492494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:51.543052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c438df4-77f7-438e-8e8e-c3c1e6a6f9b1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:51.607585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:51.608240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:51.608523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:51.608801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:51.610057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:51.612572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:51.613169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 186/375] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:51 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:51.621458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:51.664987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc023d-b6f9-4458-9b3c-983b57f07aea None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:51.711384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:51.712044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:51.712325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:51.712603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] PATH_INFO: `/v3/projects/42006892efe04f19b84a31bfb4dc5f4b` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:51.713727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] RBAC: Authorizing `identity:get_project(project_id=42006892efe04f19b84a31bfb4dc5f4b)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:51.715195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:51.722872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 190/376] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:51 2022] GET /identity/v3/projects/42006892efe04f19b84a31bfb4dc5f4b => generated 344 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:51.723859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:51.790978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:51.849840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:51.857141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b84c3-0ef6-4214-ae12-2a60c98b9eac None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:51.880335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b80077-7aee-4a40-a8fc-157b63172e74 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:51.920844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:51.920844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:51.921107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:51.921174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:51.925563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:51.927006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:51.929443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 187/377] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:51 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:51.936341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:51.958713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:51.959361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:51.959671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:51.959949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] PATH_INFO: `/v3/groups/95d6c063292c4520815c19b56c165af0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:51.972477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] RBAC: Authorizing `identity:get_group(group_id=95d6c063292c4520815c19b56c165af0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:51.974209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:51.977009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 191/378] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:51 2022] GET /identity/v3/groups/95d6c063292c4520815c19b56c165af0 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:51.982914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:52.097668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759f020-6b45-47b5-a138-67e6020d55a3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:52.164309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b175da-bd3f-47fe-8ea7-870d2c98b4f1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:52.169188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af2a41-34e5-4529-af2f-10684b93bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:52.169813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2a41-34e5-4529-af2f-10684b93bdff None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:52.170093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2a41-34e5-4529-af2f-10684b93bdff None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:52.170423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2a41-34e5-4529-af2f-10684b93bdff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:52.171164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2a41-34e5-4529-af2f-10684b93bdff None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:52.171502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2a41-34e5-4529-af2f-10684b93bdff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:52.172948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2a41-34e5-4529-af2f-10684b93bdff None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:52.181993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 188/379] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:29:51 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:52.203890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:52.238604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac772-f745-4f9f-8dbd-b6927e577c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:52.239289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac772-f745-4f9f-8dbd-b6927e577c97 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:52.244024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac772-f745-4f9f-8dbd-b6927e577c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:52.244316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac772-f745-4f9f-8dbd-b6927e577c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:52.245165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac772-f745-4f9f-8dbd-b6927e577c97 None admin] RBAC: Adding query filter params (group.id=95d6c063292c4520815c19b56c165af0, role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=42006892efe04f19b84a31bfb4dc5f4b) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:52.245485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac772-f745-4f9f-8dbd-b6927e577c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:52.247853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac772-f745-4f9f-8dbd-b6927e577c97 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:52.254659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 192/380] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:29:51 2022] GET /identity/v3/role_assignments?group.id=95d6c063292c4520815c19b56c165af0&scope.project.id=42006892efe04f19b84a31bfb4dc5f4b&role.id=8b22e1c1112547309cda07f916d1a452 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:52.823772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757c65-8e0c-4d58-a23c-c8a530e4f0bc None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:52.824122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757c65-8e0c-4d58-a23c-c8a530e4f0bc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:52.824333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757c65-8e0c-4d58-a23c-c8a530e4f0bc None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:52.826016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 189/381] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:52.831239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856235-034c-4ad1-81fc-0ef85881cc97 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:52.831560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856235-034c-4ad1-81fc-0ef85881cc97 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:52.831842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856235-034c-4ad1-81fc-0ef85881cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:52.864511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b7856235-034c-4ad1-81fc-0ef85881cc97 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:52.865769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b7856235-034c-4ad1-81fc-0ef85881cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:52.960300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 193/382] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:53.394213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757c65-8e0c-4d58-a23c-c8a530e4f0bc None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:53.429317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:53.532111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757c65-8e0c-4d58-a23c-c8a530e4f0bc None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:53.581959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660ce09-392e-4092-8f01-ce161d7e5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:53.582602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660ce09-392e-4092-8f01-ce161d7e5e93 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:53.582882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660ce09-392e-4092-8f01-ce161d7e5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:53.583155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660ce09-392e-4092-8f01-ce161d7e5e93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:53.599697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660ce09-392e-4092-8f01-ce161d7e5e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-7660ce09-392e-4092-8f01-ce161d7e5e93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:53.604537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:53.605411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:29:53.606240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 190/383] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:53.614621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856235-034c-4ad1-81fc-0ef85881cc97 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:53.623170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b15a-535e-4e25-a7f2-f204beef0acc None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:53.623490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b15a-535e-4e25-a7f2-f204beef0acc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:53.623772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b15a-535e-4e25-a7f2-f204beef0acc None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:53.625357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 191/384] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:53.632193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e106-60f9-4a4f-8616-ccf84708d861 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:53.632478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e106-60f9-4a4f-8616-ccf84708d861 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:53.632754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e106-60f9-4a4f-8616-ccf84708d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:53.662865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9176e106-60f9-4a4f-8616-ccf84708d861 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:53.664096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9176e106-60f9-4a4f-8616-ccf84708d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:53.769776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 192/385] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:53.805829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856235-034c-4ad1-81fc-0ef85881cc97 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:53.824220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:53.866029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cce1d-14ac-4e59-b8d4-d8b22c412f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:53.866886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cce1d-14ac-4e59-b8d4-d8b22c412f1e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:53.867314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cce1d-14ac-4e59-b8d4-d8b22c412f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:53.867754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cce1d-14ac-4e59-b8d4-d8b22c412f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:53.868569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cce1d-14ac-4e59-b8d4-d8b22c412f1e None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:53.869048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cce1d-14ac-4e59-b8d4-d8b22c412f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:53.870595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cce1d-14ac-4e59-b8d4-d8b22c412f1e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:53.883940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 194/386] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:53.890128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176e106-60f9-4a4f-8616-ccf84708d861 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:53.927814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:53.940033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9650b-bf5f-4f26-a275-c28ccdd0c191 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:53.940608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9650b-bf5f-4f26-a275-c28ccdd0c191 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:53.941082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9650b-bf5f-4f26-a275-c28ccdd0c191 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:53.942869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 195/387] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:53.947691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbbd16-44cf-4e38-93e9-0b2aabca93d6 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:53.948234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbbd16-44cf-4e38-93e9-0b2aabca93d6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:53.948710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbbd16-44cf-4e38-93e9-0b2aabca93d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:53.983134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ccfbbd16-44cf-4e38-93e9-0b2aabca93d6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:53.984370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ccfbbd16-44cf-4e38-93e9-0b2aabca93d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:54.034205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176e106-60f9-4a4f-8616-ccf84708d861 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:54.077848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:54.078928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:54.079408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:54.079928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:54.081945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:54.083674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:54.087775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 193/388] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:53 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:54.094388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:54.134676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 196/389] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:54.206197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:54.218283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eb554-db3f-4cdf-a297-3d4988a0a444 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:54.224020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbbd16-44cf-4e38-93e9-0b2aabca93d6 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:54.275844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:54.276816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:54.277296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:54.277842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:54.280172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:54.281638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:54.283472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 194/390] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:54 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:54.291457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:54.397606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbbd16-44cf-4e38-93e9-0b2aabca93d6 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:54.399377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:54.433123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f311a-fe4f-4e64-88c9-896e06ea6a2d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:54.468793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:54.469763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:54.471413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:54.471912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:54.490495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:54.491523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:54.492010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:54.492569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49/groups/485140aef053418c88b414b42a7ddb59/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:54.494677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] RBAC: Authorizing `identity:create_grant(project_id=863360da8758425aa2e288263bd6db49, group_id=485140aef053418c88b414b42a7ddb59, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:54.496470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:54.499819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:54.504695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:54.505623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:54.506444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:54.508855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 197/391] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:54.509952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:54.574400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 195/392] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 28 08:29:54 2022] PUT /identity/v3/projects/863360da8758425aa2e288263bd6db49/groups/485140aef053418c88b414b42a7ddb59/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:54.581123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:54.623793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:54.673887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35269e-e785-4d84-9501-152ae149970b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:54.746512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:54.747272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:54.747797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:54.748073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:54.771558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:54.776458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:54.777404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:54.778803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 198/393] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:54.786889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:54.795761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ac7bc-76fc-424d-9d5a-5ffe3974b6ca None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:54.828665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:54.854541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:54.855181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:54.855501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:54.856020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:54.857292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:54.857641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:54.859879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:54.872937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 196/394] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:54.879077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:54.941755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4b8e0-563c-46fe-b4a6-dd179e90b0c8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:54.999541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac62e3-9f18-4906-9213-39b1878db449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.000467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac62e3-9f18-4906-9213-39b1878db449 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.001027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac62e3-9f18-4906-9213-39b1878db449 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.001377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:55.001715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac62e3-9f18-4906-9213-39b1878db449 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.002584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac62e3-9f18-4906-9213-39b1878db449 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:55.003079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac62e3-9f18-4906-9213-39b1878db449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:55.004687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac62e3-9f18-4906-9213-39b1878db449 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:55.015612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 199/395] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:55.017055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f24-a9cc-4dff-961c-3b0817f01a3b None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.017456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f24-a9cc-4dff-961c-3b0817f01a3b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.017831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f24-a9cc-4dff-961c-3b0817f01a3b None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.022589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 200/396] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:55.022589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b08f24-a9cc-4dff-961c-3b0817f01a3b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:55.032649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e1986-bcf8-44b9-8ed4-127b6719e0f6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.068669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657260e-9bf3-444e-a2bc-eba391d77a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.069304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657260e-9bf3-444e-a2bc-eba391d77a9a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.069643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657260e-9bf3-444e-a2bc-eba391d77a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.069926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657260e-9bf3-444e-a2bc-eba391d77a9a None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.071030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657260e-9bf3-444e-a2bc-eba391d77a9a None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:55.072512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657260e-9bf3-444e-a2bc-eba391d77a9a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:55.074236 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 197/397] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:54 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:55.076005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce976-2432-413e-b7b8-59c23ca0f31f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.076249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce976-2432-413e-b7b8-59c23ca0f31f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.076522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ce976-2432-413e-b7b8-59c23ca0f31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.097706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-851ce976-2432-413e-b7b8-59c23ca0f31f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:55.099007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-851ce976-2432-413e-b7b8-59c23ca0f31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:55.122737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:55.140797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b08f24-a9cc-4dff-961c-3b0817f01a3b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.175373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 198/398] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:55.175373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d784-9ab7-4305-9500-949d1cd74282 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.175373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d784-9ab7-4305-9500-949d1cd74282 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.175373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0d784-9ab7-4305-9500-949d1cd74282 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.175373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 199/399] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:55.175373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d784-9ab7-4305-9500-949d1cd74282 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:55.188363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf51473-56de-4311-b68d-13f6c99d01e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.189123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf51473-56de-4311-b68d-13f6c99d01e1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.189608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf51473-56de-4311-b68d-13f6c99d01e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.189951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf51473-56de-4311-b68d-13f6c99d01e1 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.191218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf51473-56de-4311-b68d-13f6c99d01e1 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:55.192903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf51473-56de-4311-b68d-13f6c99d01e1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:55.194976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 201/400] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:55 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:55.196225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857dbb3-d938-419c-b282-13bb633cca16 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.196578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857dbb3-d938-419c-b282-13bb633cca16 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.196923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857dbb3-d938-419c-b282-13bb633cca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.220141 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8857dbb3-d938-419c-b282-13bb633cca16 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:55.221322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8857dbb3-d938-419c-b282-13bb633cca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:55.283624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:55.319467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 202/401] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:55.319467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857dbb3-d938-419c-b282-13bb633cca16 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:55.321503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0d784-9ab7-4305-9500-949d1cd74282 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.392947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.393641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.393919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.394188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.398994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:55.400434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:55.403669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 200/402] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:55 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:55.411241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:55.430438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:55.464589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857dbb3-d938-419c-b282-13bb633cca16 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.519279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.520129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.520412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.520686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.521930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:55.524085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:55.526702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 203/403] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:55 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:55.527907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:55.553690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7daef9-499d-471c-9c55-9f67c2f5fcfa None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.596818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.597565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.597937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.599560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49/groups/485140aef053418c88b414b42a7ddb59/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.602660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=863360da8758425aa2e288263bd6db49, group_id=485140aef053418c88b414b42a7ddb59, role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:55.604307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:55.640352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e9ae-ebae-4416-9e29-0385a85e0bae None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.662899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 201/404] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 28 08:29:55 2022] PUT /identity/v3/projects/863360da8758425aa2e288263bd6db49/groups/485140aef053418c88b414b42a7ddb59/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:55.664161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:55.667926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:55.690009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.690767 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.691056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.692030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.707071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:55.715877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:55.721986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 204/405] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:55.722799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:55.739126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:55.812239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a69fde-be9b-4730-b2c2-98b2f72ff9e9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.860298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1139cab-2860-4e6e-8f25-305919717034 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:55.872481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.873853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.873853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.873853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/groups/485140aef053418c88b414b42a7ddb59/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.875837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] RBAC: Authorizing `identity:create_grant(project_id=a60c137f78554bd7bd0e17ec9005b3d8, group_id=485140aef053418c88b414b42a7ddb59, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:55.877339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:55.905382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:55.906010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:55.906356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:55.906631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:55.923516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:55.928738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:55.929620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:55.930486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 205/406] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:55.931810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.018846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:56.030491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 202/407] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 28 08:29:55 2022] PUT /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/groups/485140aef053418c88b414b42a7ddb59/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:56.031322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.102718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefcd0d-e936-4bb7-bd85-3c9288034aa4 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:56.181391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:56.185469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:56.186091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:56.186367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:56.186639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:56.187314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:56.187641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:56.191525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:56.212671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 206/408] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:56.218958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.247874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48630114-542c-4395-a835-384b4e6cef6c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:56.332334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:56.333098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:56.333382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:56.333657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:56.334341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:56.334648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:56.336231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:56.352017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 203/409] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:56.356475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.413335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582df3ff-2037-40d2-8d20-d40d617da60a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:56.469196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:56.478890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:56.479900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:56.480195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:56.480643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:56.482348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:56.483837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:56.485753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 207/410] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:56 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:56.492626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.533626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa981-0fb4-432b-87b3-dcf1ca1eb9b3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:56.591786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:56.604245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:56.605282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:56.605282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:56.605513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] PATH_INFO: `/v3/groups/95d6c063292c4520815c19b56c165af0` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:56.608235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] RBAC: Authorizing `identity:get_group(group_id=95d6c063292c4520815c19b56c165af0)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:56.609650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:56.611533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 204/411] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:56 2022] GET /identity/v3/groups/95d6c063292c4520815c19b56c165af0 => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:56.617495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.683160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632260c5-cf2c-4e1f-ad85-8e483c46de18 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:56.723715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:56.724516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:56.724640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:56.724916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:56.726066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:56.727598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:56.729795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 208/412] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:56 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:56.735371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.842598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:56.878009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1769c5-a798-47ad-aa4e-c42e16fb6962 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:56.892849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4e95-d416-424b-8145-673ffc258aa6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:56.942814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:56.944805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:56.945483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:56.946726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] PATH_INFO: `/v3/projects/42006892efe04f19b84a31bfb4dc5f4b` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:56.949025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] RBAC: Authorizing `identity:get_project(project_id=42006892efe04f19b84a31bfb4dc5f4b)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:56.952204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:56.954251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 205/413] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:56 2022] GET /identity/v3/projects/42006892efe04f19b84a31bfb4dc5f4b => generated 344 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:29:56.962254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:56.966929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea103efc-6f22-432b-9865-3e568964e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:56.969171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea103efc-6f22-432b-9865-3e568964e577 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:56.969725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea103efc-6f22-432b-9865-3e568964e577 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:56.970421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea103efc-6f22-432b-9865-3e568964e577 None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/groups/485140aef053418c88b414b42a7ddb59/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:56.973954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea103efc-6f22-432b-9865-3e568964e577 None admin] RBAC: Authorizing `identity:create_grant(project_id=a60c137f78554bd7bd0e17ec9005b3d8, group_id=485140aef053418c88b414b42a7ddb59, role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:56.978224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea103efc-6f22-432b-9865-3e568964e577 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:57.042093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:57.065290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 209/414] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 28 08:29:56 2022] PUT /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8/groups/485140aef053418c88b414b42a7ddb59/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:57.104713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715141fa-6fbb-4016-9505-074bed78efb5 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:57.142600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f71868-159f-49ce-86b2-984886e93636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:57.143689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71868-159f-49ce-86b2-984886e93636 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:57.144211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71868-159f-49ce-86b2-984886e93636 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:57.144673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f71868-159f-49ce-86b2-984886e93636 None admin] PATH_INFO: `/v3/projects/42006892efe04f19b84a31bfb4dc5f4b/groups/95d6c063292c4520815c19b56c165af0/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:57.146788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f71868-159f-49ce-86b2-984886e93636 None admin] RBAC: Authorizing `identity:create_grant(project_id=42006892efe04f19b84a31bfb4dc5f4b, group_id=95d6c063292c4520815c19b56c165af0, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:57.148424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f71868-159f-49ce-86b2-984886e93636 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:57.224148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 206/415] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 28 08:29:56 2022] PUT /identity/v3/projects/42006892efe04f19b84a31bfb4dc5f4b/groups/95d6c063292c4520815c19b56c165af0/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:29:57.243080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75503-4907-43fb-803b-498ce16d8660 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:57.243828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75503-4907-43fb-803b-498ce16d8660 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:57.244326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e75503-4907-43fb-803b-498ce16d8660 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:57.246263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 210/416] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:57.252945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a368b-ddce-4e7b-8f89-044fbd9714db None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:57.253656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a368b-ddce-4e7b-8f89-044fbd9714db None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:57.254185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a368b-ddce-4e7b-8f89-044fbd9714db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:57.274772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-775a368b-ddce-4e7b-8f89-044fbd9714db None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:57.276410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-775a368b-ddce-4e7b-8f89-044fbd9714db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:57.352635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 207/417] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:57.631521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75503-4907-43fb-803b-498ce16d8660 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:57.742569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e75503-4907-43fb-803b-498ce16d8660 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:57.772146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:57.781432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:57.782485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:57.782953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:57.783380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:57.794136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:57.798856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:57.799766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:57.800587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 211/418] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:57.808492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a368b-ddce-4e7b-8f89-044fbd9714db None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:57.863961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:57.913450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a368b-ddce-4e7b-8f89-044fbd9714db None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:57.948283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:57.948899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:57.949178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:57.949967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:57.950856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:57.951247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:57.952633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:57.961408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 208/419] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:57.967702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:58.099121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139a8b3-28aa-4dff-8cb0-0c95272d6f6b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:58.140887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a33518-87fc-4689-b9de-49cfeaefa036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:58.141535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33518-87fc-4689-b9de-49cfeaefa036 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.141815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33518-87fc-4689-b9de-49cfeaefa036 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.142090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33518-87fc-4689-b9de-49cfeaefa036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.204617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:58.218957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a33518-87fc-4689-b9de-49cfeaefa036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:58.220565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a33518-87fc-4689-b9de-49cfeaefa036 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:58.353227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 212/420] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:29:58.359130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:58.448275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0f28-ba61-407a-ab84-1a9b730bc210 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.448882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0f28-ba61-407a-ab84-1a9b730bc210 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.449552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0f28-ba61-407a-ab84-1a9b730bc210 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.452308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 213/421] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:58.458001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f8ef-2cec-42b1-b2d2-ebdcf9f898d1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.458666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f8ef-2cec-42b1-b2d2-ebdcf9f898d1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.459229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f8ef-2cec-42b1-b2d2-ebdcf9f898d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.467450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fb234-7978-424f-81f1-8a0230dc09d8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:58.476492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:58.498668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:58.499298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.499611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.499892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.501009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:58.502593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:58.502713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9dc4f8ef-2cec-42b1-b2d2-ebdcf9f898d1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:58.503895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9dc4f8ef-2cec-42b1-b2d2-ebdcf9f898d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:58.504531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 209/422] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:58 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:58.510017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:58.617351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a99c-23f2-42c4-adc8-d33a87c4becb None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:58.647653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 214/423] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:58.655024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90946c0-afc8-41aa-8f6f-91c930a006ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:58.655686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90946c0-afc8-41aa-8f6f-91c930a006ed None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.655964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90946c0-afc8-41aa-8f6f-91c930a006ed None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.656237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90946c0-afc8-41aa-8f6f-91c930a006ed None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.657351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90946c0-afc8-41aa-8f6f-91c930a006ed None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:58.658775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90946c0-afc8-41aa-8f6f-91c930a006ed None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:58.660745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 210/424] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:29:58 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:58.666759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4f8ef-2cec-42b1-b2d2-ebdcf9f898d1 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:58.701434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:58.792014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505bc51-bf40-4354-b695-77fb40dbc035 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.792922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505bc51-bf40-4354-b695-77fb40dbc035 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.793911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505bc51-bf40-4354-b695-77fb40dbc035 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.796322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 211/425] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:58.801701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ceeb-567a-4b65-b4a8-9e62301ba486 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.802172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ceeb-567a-4b65-b4a8-9e62301ba486 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.802710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ceeb-567a-4b65-b4a8-9e62301ba486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.824899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-cee2ceeb-567a-4b65-b4a8-9e62301ba486 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:58.827320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4f8ef-2cec-42b1-b2d2-ebdcf9f898d1 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:58.836894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cee2ceeb-567a-4b65-b4a8-9e62301ba486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:58.893905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:58.894844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:58.896189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:58.897264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:58.898170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=863360da8758425aa2e288263bd6db49) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:58.899482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:58.902116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:58.916763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 215/426] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:29:58 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 611 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:58.935815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:58.966687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 212/427] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:29:59.059079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:59.150355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:59.171848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36251478-58d5-4e85-bebd-d95b556e549a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:59.222619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:59.223634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:59.224200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:59.224670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:59.237720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:59.242995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:59.243998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:29:59.244819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:59.251826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 216/428] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:29:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:29:59.253957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ceeb-567a-4b65-b4a8-9e62301ba486 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:59.365302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ceeb-567a-4b65-b4a8-9e62301ba486 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:59.384310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:59.415554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:59.416207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:59.416492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:59.416772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:59.417463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:59.417771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:59.420107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:59.431307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 213/429] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:29:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:59.439726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:59.490551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:59.519084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37280ea-0d57-4651-893f-fb7e593b8c2e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:59.561368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f144-0563-4a61-bcfc-91300d4595b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:59.561596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f144-0563-4a61-bcfc-91300d4595b0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:59.561815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f144-0563-4a61-bcfc-91300d4595b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:59.562538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f144-0563-4a61-bcfc-91300d4595b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:59.566470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b016-2a8b-49ee-908f-161b9eff9f88 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:59.573057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f144-0563-4a61-bcfc-91300d4595b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ade8f144-0563-4a61-bcfc-91300d4595b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:29:59.578442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:29:59.579357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:29:59.580319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 217/430] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:29:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:29:59.581025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a9def-a594-45cb-a21c-2e0e71e96b77 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:59.581307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a9def-a594-45cb-a21c-2e0e71e96b77 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:59.581582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a9def-a594-45cb-a21c-2e0e71e96b77 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:59.582898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 218/431] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:29:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:29:59.591477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a9def-a594-45cb-a21c-2e0e71e96b77 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:59.592733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:59.621791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:59.622755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:59.623393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:59.623740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:59.714580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:59.716364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:59.729220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a9def-a594-45cb-a21c-2e0e71e96b77 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:59.769496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:59.777314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7278a-e3c4-434f-8205-855beb147ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:29:59.777921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7278a-e3c4-434f-8205-855beb147ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:59.778200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7278a-e3c4-434f-8205-855beb147ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:59.778470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7278a-e3c4-434f-8205-855beb147ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:59.779144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7278a-e3c4-434f-8205-855beb147ba2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:29:59.779463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7278a-e3c4-434f-8205-855beb147ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:29:59.780848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7278a-e3c4-434f-8205-855beb147ba2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:29:59.790205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 219/432] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:29:59.792323 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac45e2-39ad-4eaf-be80-2f227f203885 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:29:59.792975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac45e2-39ad-4eaf-be80-2f227f203885 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:29:59.793852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac45e2-39ad-4eaf-be80-2f227f203885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:29:59.812689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-69ac45e2-39ad-4eaf-be80-2f227f203885 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:29:59.813888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-69ac45e2-39ad-4eaf-be80-2f227f203885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:29:59.833357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 214/433] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:29:59.833357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:59.877587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:29:59.889074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 220/434] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:29:59.889912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac45e2-39ad-4eaf-be80-2f227f203885 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:29:59.955183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a50d8-10c2-41ee-8dd1-a62dfe4989ac None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:29:59.999377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd852a-4b25-4efb-aedf-e138f5d1d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.000087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd852a-4b25-4efb-aedf-e138f5d1d1de None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.000369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd852a-4b25-4efb-aedf-e138f5d1d1de None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.000640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd852a-4b25-4efb-aedf-e138f5d1d1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.015737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.037869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac45e2-39ad-4eaf-be80-2f227f203885 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.086439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.086878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd852a-4b25-4efb-aedf-e138f5d1d1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.087684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.088197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.088408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd852a-4b25-4efb-aedf-e138f5d1d1de None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.088874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] PATH_INFO: `/v3/projects/863360da8758425aa2e288263bd6db49` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.090426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=863360da8758425aa2e288263bd6db49)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.092646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.096256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 221/435] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:29:59 2022] GET /identity/v3/projects/863360da8758425aa2e288263bd6db49 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:00.101132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.176865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.201995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 215/436] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:00.203245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316b9f-8cc9-4538-a635-42f06817163d None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.203557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316b9f-8cc9-4538-a635-42f06817163d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.203837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316b9f-8cc9-4538-a635-42f06817163d None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.205413 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 216/437] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:00.206048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2316b9f-8cc9-4538-a635-42f06817163d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.217838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caa0ce-c3b3-4c57-b705-6f1f8c77b2d2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.249373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.250906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.251563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.251843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.252115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.253212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.254627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.256207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 222/438] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:00.256959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.305890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2316b9f-8cc9-4538-a635-42f06817163d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.338596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b57b4b-2161-4f2a-af6f-feae3c58a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.339216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57b4b-2161-4f2a-af6f-feae3c58a32b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.339520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57b4b-2161-4f2a-af6f-feae3c58a32b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.339794 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b57b4b-2161-4f2a-af6f-feae3c58a32b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.350169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b57b4b-2161-4f2a-af6f-feae3c58a32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-38b57b4b-2161-4f2a-af6f-feae3c58a32b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:00.354950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:00.356507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:00.357333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 217/439] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:00.358268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3695b-9040-4883-bc62-b966397b3a05 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.358601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3695b-9040-4883-bc62-b966397b3a05 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.358812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3695b-9040-4883-bc62-b966397b3a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.361735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d334f-c4fe-4406-b171-469633a44f44 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.376207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b9c3695b-9040-4883-bc62-b966397b3a05 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:00.377381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b9c3695b-9040-4883-bc62-b966397b3a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:00.390680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.396364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.396991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.397271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.397547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.400861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.400861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.401747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 223/440] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:00.403025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.448119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 218/441] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:00.448883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3695b-9040-4883-bc62-b966397b3a05 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.486462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.507413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20995235-6fae-4158-928a-df15e4ea85bc None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.542656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.543385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.543648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.543884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.544590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=863360da8758425aa2e288263bd6db49) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:00.544898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.546329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.563451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 224/442] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=863360da8758425aa2e288263bd6db49&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:00.563451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.580705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3695b-9040-4883-bc62-b966397b3a05 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.620214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.620839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.621120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.621952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.622632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:00.622937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.624344 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.630569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.633655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 219/443] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:00.640462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.677406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb87bb-a6df-42ee-ac3a-b3624dfcd309 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.717658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.718841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.719200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.719512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.720724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.722198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.727463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 225/444] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:00.727463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:00.755892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.765574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0d44-d190-49c5-bc4a-a18d33de4072 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.811168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.811947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.812238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.812513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.843315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81c88-c9a1-4092-adf7-f201e995ab3c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:00.881376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:00.886503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:00.892293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:00.892293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:00.892293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:00.894584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:00.896098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:00.901617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:00.907481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:00.908399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:00.909221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 226/445] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:00.909878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.005309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:01.013158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 220/446] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:30:01.015569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ee788-ea47-44f3-b835-9fa703b1ae81 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.016454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.050720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57401006-5437-491c-b194-85f130a601e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.051324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401006-5437-491c-b194-85f130a601e3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.051628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401006-5437-491c-b194-85f130a601e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.051906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401006-5437-491c-b194-85f130a601e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.052630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57401006-5437-491c-b194-85f130a601e3 None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=23ec368052424f10b0ffccb344cf6b5c, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:01.052942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57401006-5437-491c-b194-85f130a601e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.054383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57401006-5437-491c-b194-85f130a601e3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.060176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 227/447] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:30:00 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=23ec368052424f10b0ffccb344cf6b5c => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:01.060995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57401006-5437-491c-b194-85f130a601e3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.125234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:01.140948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139cad-4cff-442e-824a-006e99705755 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.175708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57401006-5437-491c-b194-85f130a601e3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.179535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.180482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.181009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.181482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.182411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:01.182935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.185098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.194515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 221/448] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:01.200975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.215086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.215765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.216153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.216432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] PATH_INFO: `/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.217608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] RBAC: Authorizing `identity:get_project(project_id=a60c137f78554bd7bd0e17ec9005b3d8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.219115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.220924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 228/449] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/projects/a60c137f78554bd7bd0e17ec9005b3d8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:01.233643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.271186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:01.323077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733da6-0fd2-4385-877c-cdde8eed35c7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.356856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322146f-05a3-4736-90f6-c1f14680597c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.364294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.364913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.366047 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.366047 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.383608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:01.399086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.400051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.404445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.404445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] PATH_INFO: `/v3/groups/485140aef053418c88b414b42a7ddb59` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.404445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] RBAC: Authorizing `identity:get_group(group_id=485140aef053418c88b414b42a7ddb59)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.404445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.410141 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 229/450] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/groups/485140aef053418c88b414b42a7ddb59 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:01.411299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.453214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.455480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.512988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:01.519107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992295-1b99-40fe-a44a-b43232a26525 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.552382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.552906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.553181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.553456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.554166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] RBAC: Adding query filter params (group.id=485140aef053418c88b414b42a7ddb59, role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:01.554468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.555940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.556037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 222/451] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:30:01.562196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.562621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 230/452] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/role_assignments?group.id=485140aef053418c88b414b42a7ddb59&scope.project.id=a60c137f78554bd7bd0e17ec9005b3d8&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:01.664041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35132a2a-93df-4fb1-816a-59ebb18a3da8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.701824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.702471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.702753 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.703028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] PATH_INFO: `/v3/projects/42006892efe04f19b84a31bfb4dc5f4b` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.704226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] RBAC: Authorizing `identity:get_project(project_id=42006892efe04f19b84a31bfb4dc5f4b)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.705682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.707405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 223/453] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/projects/42006892efe04f19b84a31bfb4dc5f4b => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:01.713073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.771281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:01.817245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269a84-23bf-41d1-aa6f-6f96b260ee10 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.850147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cbeba-6645-4084-96bc-c56eb1a035d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.850818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cbeba-6645-4084-96bc-c56eb1a035d6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.851102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cbeba-6645-4084-96bc-c56eb1a035d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:01.851371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cbeba-6645-4084-96bc-c56eb1a035d6 None admin] PATH_INFO: `/v3/groups/95d6c063292c4520815c19b56c165af0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:01.852495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cbeba-6645-4084-96bc-c56eb1a035d6 None admin] RBAC: Authorizing `identity:get_group(group_id=95d6c063292c4520815c19b56c165af0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:01.853916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cbeba-6645-4084-96bc-c56eb1a035d6 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:01.855482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 231/454] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/groups/95d6c063292c4520815c19b56c165af0 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:01.861901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:01.888755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:01.964858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dceef-19f4-4d55-b956-d3caad65daf6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:01.998937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163ebb4-6851-4361-9a23-43a3c64ae97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:01.999564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ebb4-6851-4361-9a23-43a3c64ae97c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:01.999847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ebb4-6851-4361-9a23-43a3c64ae97c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:02.000119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ebb4-6851-4361-9a23-43a3c64ae97c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:02.000838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ebb4-6851-4361-9a23-43a3c64ae97c None admin] RBAC: Adding query filter params (group.id=95d6c063292c4520815c19b56c165af0, role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=42006892efe04f19b84a31bfb4dc5f4b) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:02.001144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ebb4-6851-4361-9a23-43a3c64ae97c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:02.002562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ebb4-6851-4361-9a23-43a3c64ae97c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:02.008037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 224/455] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 28 08:30:01 2022] GET /identity/v3/role_assignments?group.id=95d6c063292c4520815c19b56c165af0&scope.project.id=42006892efe04f19b84a31bfb4dc5f4b&role.id=8b22e1c1112547309cda07f916d1a452 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:04.501160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0c818-ef1f-469c-92d2-3de19ad96321 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:04.502151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0c818-ef1f-469c-92d2-3de19ad96321 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:04.502667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0c818-ef1f-469c-92d2-3de19ad96321 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:04.504438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 232/456] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:04.509993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7904-f534-43bc-8075-e1aca153a8d4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:04.510722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7904-f534-43bc-8075-e1aca153a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:04.511138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7904-f534-43bc-8075-e1aca153a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:04.540459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-795a7904-f534-43bc-8075-e1aca153a8d4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:04.541880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-795a7904-f534-43bc-8075-e1aca153a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:04.630427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 225/457] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:04.767024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e6c7-4d7f-4d83-8c29-7ad0e115d89f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:04.767684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e6c7-4d7f-4d83-8c29-7ad0e115d89f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:04.768186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e6c7-4d7f-4d83-8c29-7ad0e115d89f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:04.770045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 233/458] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:04.775028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fdd-5a41-4c7b-a125-ccc78b21630c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:04.775313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fdd-5a41-4c7b-a125-ccc78b21630c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:04.775611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fdd-5a41-4c7b-a125-ccc78b21630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:04.801129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1f238fdd-5a41-4c7b-a125-ccc78b21630c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:04.802457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1f238fdd-5a41-4c7b-a125-ccc78b21630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:04.822152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:04.900926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 226/459] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:04.990728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4e6c7-4d7f-4d83-8c29-7ad0e115d89f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:05.125220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4e6c7-4d7f-4d83-8c29-7ad0e115d89f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:05.156595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:05.171773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:05.172436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.172721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.172998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.182804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fdd-5a41-4c7b-a125-ccc78b21630c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:05.186436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:05.186923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:05.206436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:05.207446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:05.208316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:05.208316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:05.208316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:05.208316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 234/460] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:05.218056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:05.367296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fdd-5a41-4c7b-a125-ccc78b21630c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:05.368405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ebde-5f1f-4911-adf0-28845d843b1c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:05.405867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f566e3-f998-439b-9a75-34a8992bfdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:05.406787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f566e3-f998-439b-9a75-34a8992bfdbe None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.406892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a787d66-bb9d-4e71-92d9-5dae87ec0844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:05.407377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f566e3-f998-439b-9a75-34a8992bfdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.407634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787d66-bb9d-4e71-92d9-5dae87ec0844 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.407992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787d66-bb9d-4e71-92d9-5dae87ec0844 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.408219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f566e3-f998-439b-9a75-34a8992bfdbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.408359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787d66-bb9d-4e71-92d9-5dae87ec0844 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.409102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a787d66-bb9d-4e71-92d9-5dae87ec0844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:05.409475 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a787d66-bb9d-4e71-92d9-5dae87ec0844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:05.411044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a787d66-bb9d-4e71-92d9-5dae87ec0844 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:05.419846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f566e3-f998-439b-9a75-34a8992bfdbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:05.421519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f566e3-f998-439b-9a75-34a8992bfdbe None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:05.430511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:05.431313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 235/461] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:05.432860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f565d-4a52-4ff7-a11f-f0f3cf219675 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.433275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f565d-4a52-4ff7-a11f-f0f3cf219675 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.433790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f565d-4a52-4ff7-a11f-f0f3cf219675 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.435746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 236/462] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:05.438257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f565d-4a52-4ff7-a11f-f0f3cf219675 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-55f566e3-f998-439b-9a75-34a8992bfdbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:05.443749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:05.444615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:05.445470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:05.445470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:05.445470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:05.445470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 227/463] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:05.445470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f0e7-ac98-4c89-afc3-b3cbc1dc3590 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.445470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f0e7-ac98-4c89-afc3-b3cbc1dc3590 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.445470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f0e7-ac98-4c89-afc3-b3cbc1dc3590 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.446542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 228/464] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:05.447892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62f60-ad64-4f87-9db9-ff4dda71ef6b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.448308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62f60-ad64-4f87-9db9-ff4dda71ef6b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.448732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62f60-ad64-4f87-9db9-ff4dda71ef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.471474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-73b62f60-ad64-4f87-9db9-ff4dda71ef6b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:05.472666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-73b62f60-ad64-4f87-9db9-ff4dda71ef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:05.478117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:05.547165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f565d-4a52-4ff7-a11f-f0f3cf219675 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:05.551555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 229/465] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:05.552928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62f60-ad64-4f87-9db9-ff4dda71ef6b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:05.592707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2a7f-5ed7-44e9-a31b-c7bf574bd201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:05.593548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2a7f-5ed7-44e9-a31b-c7bf574bd201 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.593963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2a7f-5ed7-44e9-a31b-c7bf574bd201 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.594371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2a7f-5ed7-44e9-a31b-c7bf574bd201 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.595168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2a7f-5ed7-44e9-a31b-c7bf574bd201 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:05.596782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2a7f-5ed7-44e9-a31b-c7bf574bd201 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:05.665892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62f60-ad64-4f87-9db9-ff4dda71ef6b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:05.692030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 237/466] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:30:05 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:05.694343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0b71-8458-48e4-a052-95ab921bc545 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.694898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0b71-8458-48e4-a052-95ab921bc545 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.695360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0b71-8458-48e4-a052-95ab921bc545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.695946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:05.702075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:05.703102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.703381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.703690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.704331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:05.704631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:05.711525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:05.718979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 230/467] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:05.726325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:05.736918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fedd0b71-8458-48e4-a052-95ab921bc545 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:05.738997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fedd0b71-8458-48e4-a052-95ab921bc545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:05.820491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 238/468] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:05.823172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0b71-8458-48e4-a052-95ab921bc545 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:05.855280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:05.942949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0b71-8458-48e4-a052-95ab921bc545 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:05.952387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32b87-214c-48fd-979a-90967b7f70da None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:05.979054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:05.979708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.979984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.980253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.992238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:05.992849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:05.993112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:05.993216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:05.993380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:05.994030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:05.994582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:05.997201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:06.011820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:06.013085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:06.014017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:06.014017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:06.014017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:06.014017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 239/469] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:06.019093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:06.083969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 231/470] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:30:05 2022] POST /identity/v3/users => generated 248 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:06.099741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:06.141166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b00c4-1456-4d8c-9263-c8f2b6ee29b0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:06.178568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:06.181793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:06.182420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:06.182698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:06.182969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:06.184182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:06.184491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:06.185879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:06.213758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 240/471] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:06.219443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:06.243451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:06.353663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbe438-74b1-4814-bd02-4f12ef5f5d42 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:06.390452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ea5e4-b433-4f5f-9801-7aa9d1f4630e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:06.402695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0cf67-7a8e-411f-927f-fa83429a4f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:06.403817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0cf67-7a8e-411f-927f-fa83429a4f22 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:06.404109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0cf67-7a8e-411f-927f-fa83429a4f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:06.404384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0cf67-7a8e-411f-927f-fa83429a4f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:06.416977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0cf67-7a8e-411f-927f-fa83429a4f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:06.418728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0cf67-7a8e-411f-927f-fa83429a4f22 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:06.427400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:06.432758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ed306-e8da-4828-848a-dc6d3f42081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:06.433304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed306-e8da-4828-848a-dc6d3f42081c None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:06.434158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed306-e8da-4828-848a-dc6d3f42081c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:06.434434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed306-e8da-4828-848a-dc6d3f42081c None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:06.435088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ed306-e8da-4828-848a-dc6d3f42081c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:06.436587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ed306-e8da-4828-848a-dc6d3f42081c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-20b0cf67-7a8e-411f-927f-fa83429a4f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:06.437199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:06.445200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:06.446149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:06.446149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:06.446149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:06.446149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 232/472] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:06.446149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1619f-8302-4512-9ece-881e0183b678 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:06.446149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1619f-8302-4512-9ece-881e0183b678 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:06.446149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1619f-8302-4512-9ece-881e0183b678 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:06.446826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 233/473] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:06.447816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1619f-8302-4512-9ece-881e0183b678 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:06.545349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 241/474] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:30:06 2022] POST /identity/v3/users => generated 249 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:06.548717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9ac82-1ea0-4f6b-8c6d-0535e58b8c68 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:06.549814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9ac82-1ea0-4f6b-8c6d-0535e58b8c68 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:06.550231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9ac82-1ea0-4f6b-8c6d-0535e58b8c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:06.571677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:06.586463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1619f-8302-4512-9ece-881e0183b678 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:06.599224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-13c9ac82-1ea0-4f6b-8c6d-0535e58b8c68 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:06.602501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-13c9ac82-1ea0-4f6b-8c6d-0535e58b8c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:06.668127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:06.669546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:06.669858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:06.670191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:06.670862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:06.671212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:06.672664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:06.712421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 242/475] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:06.712603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 234/476] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:06.712705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9ac82-1ea0-4f6b-8c6d-0535e58b8c68 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:06.862235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9ac82-1ea0-4f6b-8c6d-0535e58b8c68 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:06.885392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:06.906573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:06.907195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:06.907496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:06.907774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:06.908423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:06.909874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:07.018471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 243/477] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:30:06 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:07.048725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:07.186263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926e1a3-e5da-4108-bd30-586b6e92ef60 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:07.223771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:07.224385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:07.224662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:07.224932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:07.225606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:07.226988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:07.274408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.sql.core [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 08:30:07.274408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 28 08:30:07.274408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [parameters: {'id': '9135d63986c04b08bc64b9519705599f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 28 08:30:07.274408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81844) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application conn.query(q) Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result.read() Sep 28 08:30:07.297717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return ref.to_dict() Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 08:30:07.298650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application next(self.gen) Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application yield resource Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application next(self.gen) Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise self.value Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application session.commit() Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 08:30:07.299607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.session.flush() Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application compat.raise_( Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 08:30:07.300515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 08:30:07.301401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application conn.query(q) Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result.read() Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 08:30:07.302314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [parameters: {'id': '9135d63986c04b08bc64b9519705599f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:07.303111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 28 08:30:07.305371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:07.306423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 235/478] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 28 08:30:07 2022] POST /identity/v3/roles => generated 144 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:07.314305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:07.428402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec288d-e342-43f0-a38d-f67bd68e04c9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:07.464803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42ffd-14b5-43cd-9aa1-582f21cc64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:07.465666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42ffd-14b5-43cd-9aa1-582f21cc64c6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:07.466093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42ffd-14b5-43cd-9aa1-582f21cc64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:07.466529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42ffd-14b5-43cd-9aa1-582f21cc64c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:07.477251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42ffd-14b5-43cd-9aa1-582f21cc64c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9ba42ffd-14b5-43cd-9aa1-582f21cc64c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:07.482718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:07.483836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 28 08:30:07.484835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:07.486974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 244/479] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:07.492874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:07.527497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:07.617860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64377d0-356b-4a91-a947-783f541f3102 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:07.653300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d7ed-5c8a-4833-808e-d4cf2d63cf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:07.654142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d7ed-5c8a-4833-808e-d4cf2d63cf37 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:07.654562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d7ed-5c8a-4833-808e-d4cf2d63cf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:07.654998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d7ed-5c8a-4833-808e-d4cf2d63cf37 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:07.655819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d7ed-5c8a-4833-808e-d4cf2d63cf37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:07.656259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d7ed-5c8a-4833-808e-d4cf2d63cf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:07.657751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d7ed-5c8a-4833-808e-d4cf2d63cf37 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:07.667331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 236/480] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:08.345544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1a84-ca01-44f7-8d05-1ffdc1228d0d None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:08.346061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1a84-ca01-44f7-8d05-1ffdc1228d0d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:08.346061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1a84-ca01-44f7-8d05-1ffdc1228d0d None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:08.347730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 245/481] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:08.353216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46f72a-4609-43aa-8be5-6fdaf38f3fc4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:08.353516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46f72a-4609-43aa-8be5-6fdaf38f3fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:08.353797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46f72a-4609-43aa-8be5-6fdaf38f3fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:08.372441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3b46f72a-4609-43aa-8be5-6fdaf38f3fc4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:08.373632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3b46f72a-4609-43aa-8be5-6fdaf38f3fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:08.455342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 237/482] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:08.825458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb2ea-1392-44d8-998c-79c5b145fafe None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:08.825736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb2ea-1392-44d8-998c-79c5b145fafe None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:08.826175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb2ea-1392-44d8-998c-79c5b145fafe None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:08.828031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 246/483] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:08.833080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d549f-6c47-4188-9d37-0a3ffc7322f4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:08.833867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d549f-6c47-4188-9d37-0a3ffc7322f4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:08.834292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d549f-6c47-4188-9d37-0a3ffc7322f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:08.856471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0d8d549f-6c47-4188-9d37-0a3ffc7322f4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:08.857878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0d8d549f-6c47-4188-9d37-0a3ffc7322f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:08.867732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:08.928904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fb2ea-1392-44d8-998c-79c5b145fafe None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:08.944182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 238/484] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:09.017829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:09.113154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fb2ea-1392-44d8-998c-79c5b145fafe None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:09.158297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:09.158961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.159243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.159547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.176810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:09.181883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:09.182776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:09.184291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 247/485] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:09.189627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d549f-6c47-4188-9d37-0a3ffc7322f4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:09.323457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:09.393517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d549f-6c47-4188-9d37-0a3ffc7322f4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:09.442190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc83be-e650-4088-9727-656055bd9244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:09.443077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc83be-e650-4088-9727-656055bd9244 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.443365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc83be-e650-4088-9727-656055bd9244 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.443667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc83be-e650-4088-9727-656055bd9244 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.444607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc83be-e650-4088-9727-656055bd9244 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:09.445355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc83be-e650-4088-9727-656055bd9244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:09.446981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc83be-e650-4088-9727-656055bd9244 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:09.447463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:09.455534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58845893-d74d-4c29-8151-6f76cec87af4 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:09.460264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 239/486] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:09.461683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6140b-6b40-4128-9ee6-3f3c99592626 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.462036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6140b-6b40-4128-9ee6-3f3c99592626 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.462381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6140b-6b40-4128-9ee6-3f3c99592626 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.463954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 240/487] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:09.469488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdadfc-a14b-49bd-b472-8a3164f949ca None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.469776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdadfc-a14b-49bd-b472-8a3164f949ca None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.470054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdadfc-a14b-49bd-b472-8a3164f949ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.483576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:09.489809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-59cdadfc-a14b-49bd-b472-8a3164f949ca None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:09.491251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-59cdadfc-a14b-49bd-b472-8a3164f949ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:09.499342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:09.500013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.500292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.500565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.513366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:09.519511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:09.520607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 248/488] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:09.521885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:09.583511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 241/489] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:30:09.584668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdadfc-a14b-49bd-b472-8a3164f949ca None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:09.690613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee74cf-b353-484a-8955-a16761c39f30 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:09.768908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:09.769797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.770213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.770617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.784881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:09.787161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:09.803338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdadfc-a14b-49bd-b472-8a3164f949ca None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:09.804217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:09.805114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:09.805978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:09.805978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:09.805978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:09.807873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 249/490] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:09.814956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:09.824995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:09.898250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:09.898944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.899152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.899445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.900131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:09.900437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:09.906188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:09.907875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:09.926573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 242/491] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:09.928061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:09.941631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673052e1-4c32-4ff6-a5c7-1e1b7ee92fb2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:09.985598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:09.986200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:09.986527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:09.986803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:09.987459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:09.987770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:09.989294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.006555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 250/492] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:10.007468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.062590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7ecd-7649-41af-bec3-1fdf75b8eace None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.088853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:10.099257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.099941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.100216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.100486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.119173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:10.119581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:10.120454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:10.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 243/493] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:10.122815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.129565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d5594-60cd-4546-83e0-aa9482651752 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.167510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04ab18-2435-4345-aa58-3f15edcdf3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.168711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ab18-2435-4345-aa58-3f15edcdf3dc None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.168711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ab18-2435-4345-aa58-3f15edcdf3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.168970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ab18-2435-4345-aa58-3f15edcdf3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.179550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04ab18-2435-4345-aa58-3f15edcdf3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.181015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04ab18-2435-4345-aa58-3f15edcdf3dc None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.187152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-7a04ab18-2435-4345-aa58-3f15edcdf3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:10.199886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:10.200870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:10.201722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:10.201722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:10.201722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:10.207444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 251/494] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:10.208407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f950-5c95-4290-9e12-7e4ff40e7b0a None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.208686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f950-5c95-4290-9e12-7e4ff40e7b0a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.208954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7f950-5c95-4290-9e12-7e4ff40e7b0a None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.210478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 252/495] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:10.211172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f950-5c95-4290-9e12-7e4ff40e7b0a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.235529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ad525-bd0e-4689-96a1-d0999b08d5b0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.278902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.279681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.279966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.280239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.293691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.295888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:10.310196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:10.311329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:10.312577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:10.316402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 244/496] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:10.317170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.325074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7f950-5c95-4290-9e12-7e4ff40e7b0a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.344500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:10.363669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c26cb-845d-42b6-9fcd-2f85e90e46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.364280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c26cb-845d-42b6-9fcd-2f85e90e46b8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.364561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c26cb-845d-42b6-9fcd-2f85e90e46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.364839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c26cb-845d-42b6-9fcd-2f85e90e46b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.365509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c26cb-845d-42b6-9fcd-2f85e90e46b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:10.365817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c26cb-845d-42b6-9fcd-2f85e90e46b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.367224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c26cb-845d-42b6-9fcd-2f85e90e46b8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.375779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 253/497] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:10.375779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed266a-37e6-42e4-afcc-426b3614fc67 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.375779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed266a-37e6-42e4-afcc-426b3614fc67 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.375779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed266a-37e6-42e4-afcc-426b3614fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.398733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f5ed266a-37e6-42e4-afcc-426b3614fc67 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:10.400019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f5ed266a-37e6-42e4-afcc-426b3614fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:10.441127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601e65-92c6-46be-a7ea-85767ba479c9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.461705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:10.474474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 254/498] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:10.475322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed266a-37e6-42e4-afcc-426b3614fc67 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.490907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.491891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.492525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.492871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.493596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:10.494025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.495666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.509804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 245/499] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:10.510711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.591236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed266a-37e6-42e4-afcc-426b3614fc67 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.601960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:10.618145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2326a-cb74-428c-a659-7290015885d2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.625647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9cb5e-c03d-45a8-8e44-b75bc7268524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.626286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9cb5e-c03d-45a8-8e44-b75bc7268524 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.626586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9cb5e-c03d-45a8-8e44-b75bc7268524 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.626916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9cb5e-c03d-45a8-8e44-b75bc7268524 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.627671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9cb5e-c03d-45a8-8e44-b75bc7268524 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:10.627973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9cb5e-c03d-45a8-8e44-b75bc7268524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.629413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9cb5e-c03d-45a8-8e44-b75bc7268524 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.657902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.658531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.658810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.659078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.668077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 255/500] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:10.669522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea839d6-757d-4fa8-a085-97e3e81c3929 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.669809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea839d6-757d-4fa8-a085-97e3e81c3929 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.670083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea839d6-757d-4fa8-a085-97e3e81c3929 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.671450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 256/501] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:10.674080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.675720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.676048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea839d6-757d-4fa8-a085-97e3e81c3929 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:10.691094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:10.692263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:10.693172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:10.693172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:10.693172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:10.696798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 246/502] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:10.697525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.729227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:10.782293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea839d6-757d-4fa8-a085-97e3e81c3929 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.799694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bfaa-2f28-4d9b-ad9a-a303b9922882 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:10.815331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef85ee4-d258-4a19-9404-a3f399ebf714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.815980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85ee4-d258-4a19-9404-a3f399ebf714 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.816258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85ee4-d258-4a19-9404-a3f399ebf714 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.816531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85ee4-d258-4a19-9404-a3f399ebf714 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.823351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef85ee4-d258-4a19-9404-a3f399ebf714 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.825367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef85ee4-d258-4a19-9404-a3f399ebf714 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.832932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:10.833538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.833820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.834093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-eef85ee4-d258-4a19-9404-a3f399ebf714 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:10.837921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:10.838794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 257/503] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:10.840855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e03bc-6032-4726-bea4-b582b68488b2 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:10.841486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e03bc-6032-4726-bea4-b582b68488b2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:10.841486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e03bc-6032-4726-bea4-b582b68488b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:10.859232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ec3e03bc-6032-4726-bea4-b582b68488b2 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:10.860471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ec3e03bc-6032-4726-bea4-b582b68488b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:10.883053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:10.902957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:10.904561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:10.930531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 258/504] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:10.931383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e03bc-6032-4726-bea4-b582b68488b2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:10.938480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.008830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 247/505] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:11.008830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.041267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e03bc-6032-4726-bea4-b582b68488b2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.079411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.080041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.080313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.080576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.081213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:11.081508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.082905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.098688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 259/506] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:11.098688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.112120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381e100-9230-4ee6-9476-b05611bb7480 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.115732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.142716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.148805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.149449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.149727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.149999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.162648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:11.167756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:11.168736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:11.169615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:11.172340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 248/507] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:11.172340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.200615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab434d2-ef56-4767-a789-765076d1a4fb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.237097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.237719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.237998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.238789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.239537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:11.239844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.242877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.263195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 260/508] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:11.263983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.282454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02917118-da11-49a7-a827-c77b2e856eab None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.316246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.316870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.317150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.317425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.327789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.329231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.337857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:11.343399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:11.349747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:11.350822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:11.350822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:11.350822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:11.350822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 249/509] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:11.350822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.360813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dca98d-2884-4a4d-ad0b-90b34db5e5f9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.390757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.394979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.395634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.401173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.401173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.403681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.405147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:11.416590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:11.418175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:11.419109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 261/510] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:11.419746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.449805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9113261-dc94-4f8e-833b-e9b140904bb7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.482863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.483616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.483895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.484171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.484829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:11.485130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.486505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.494233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 250/511] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:11.495033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.521197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616e07-f6d9-42e3-bfb3-6a7331e91c86 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.553890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.554499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.554771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.555040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.557619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.565852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.570858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:11.581618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:11.582647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:11.583559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:11.583559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:11.583559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:11.583559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 262/512] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:11.583559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.598449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917b7b-54ef-489b-af18-07e41d3eceb6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.600771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.632970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.633558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.633835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.634110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.682039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be75f9-0200-40fd-8b80-802f924b5880 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.700860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.702317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.715593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.716188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.716465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.716736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.717369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:11.717668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.719092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.730492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 263/513] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:11.731268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.782136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.806011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 251/514] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:11.806858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.812279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:11.832628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26b073-d29e-4923-952b-fe7e84f83ee8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.864942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.865541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.865821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.866093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.866806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:11.867111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.868575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.886182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 264/515] 10.222.0.57 () {56 vars in 1139 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:11.887863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.906568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ccb9c-7380-4578-9542-6ee3ddba3f2f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.942034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:11.942658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:11.942934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:11.943198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:11.954156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:11.955630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:11.969275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:11.970214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:11.971076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:11.971076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:11.971076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:11.971076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 252/516] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:11.971076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:11.992118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf07cb-729a-4793-a223-2b5e932f4351 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:11.999953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.025795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.026261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.026862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.027237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.027596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.028264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:12.028569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.029939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.041099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 265/517] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:12.041820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.070558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3daf-1895-4e0c-bf4e-a1a60a253840 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.103303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.103953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.104232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.104502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.111518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.112950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:12.124797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:12.125745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 253/518] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:12.126604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.149117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892571-574e-42dd-a0c9-b1fe5769c91f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.181760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.182400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.182678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.182946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.193360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.194797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:12.209004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:12.209944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:12.210809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:12.210809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:12.210809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:12.210809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 266/519] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:12.210809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.229992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.232489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b0297-12a5-47ef-bebf-1b06aea06991 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.248219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.265845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.266448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.266723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.266993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.312261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee3803-bcbd-40dd-a267-2d2ff7e9225b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.333877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.335310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.344666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.345262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.345548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.345799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.346432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:12.346726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.348115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.359451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 267/520] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:12.360207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.437007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.439375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 254/521] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:12.440245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.457592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a94419-d1d5-4e29-bdd6-a04dfe8aca72 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.461123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.491288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.491911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.492188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.492454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.493081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.494524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.536891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d0512-a307-471f-845a-d78c5c897273 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.564230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 268/522] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:30:12 2022] POST /identity/v3/users => generated 247 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:12.564962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.570295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.570946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.571223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.571520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.572227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:12.572528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.573994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.599903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 255/523] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:12.599903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.691492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.695330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d855f-93bb-4a35-be6f-2c1d4b0208e8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.716041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c9d7c-b260-441b-bbca-c6174cabd9ae None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.734471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.735096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.735372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.735696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.736352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:12.736656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.738037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.740126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.754982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 269/524] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:12.755158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.756913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.757556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.757999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.758277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.769217 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.770746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:12.785203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:12.786338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 256/525] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:12.787259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.869838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00913cce-b9ec-4f63-9611-9d53bf571bbb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.901111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139670c-ef4e-4460-b07a-6d5f15f97814 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:12.903348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.904011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.904285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.904555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.916618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.919085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:12.934995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:12.935981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:12.936838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:12.936838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:12.936838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:12.936838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 270/526] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:12.937066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.950331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:12.950935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:12.951214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:12.951517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:12.952245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=0969ec55ae1244c09694079a72bf8310) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:12.952609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:12.954256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:12.957318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:12.971512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 257/527] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/role_assignments?user.id=0969ec55ae1244c09694079a72bf8310&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:12.971512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:12.998295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:13.076003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f7544-92f4-43a5-b97b-213acb34b3c8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.091742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef40e-c66d-4ce4-ab79-681309bd1e7f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.121538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.122352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.122696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.123061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.130939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.132569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.140792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.141421 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.141705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.141982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.142750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:13.143048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.144686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:13.150013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:13.152792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 271/528] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:13.154859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:13.187915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 258/529] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 28 08:30:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:13.189101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:13.263654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:13.276367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b0a84-f476-4b7d-94d5-b94866873d32 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.284922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:13.320419 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29738f-f7bf-4583-a065-a75098e1f7b1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.321858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.322848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.323378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.324487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.325636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:13.326147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.327773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.342224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 272/530] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:13.343462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:13.364992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.366316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.366608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.366868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.367602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:13.367909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.369340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.386718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 259/531] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:13.388018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:13.484590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842efeef-a55d-4020-abe9-e3bdeb1ad833 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.508734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb8702-fa7a-45e9-8dd7-740087e0cb49 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.530247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:13.534962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.535610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.535888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.536153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.550775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.551815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.552313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.552991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.561494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.563191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:13.575740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:13.576607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:13.577446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:13.579496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 260/532] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:13.580478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:13.584472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:13.621739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.623264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.717714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df6bb-87f4-4746-bec9-596274737687 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.736318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 273/533] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:13.737704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:13.755934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.756547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.756829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.757139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.757944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=d0570ef979ab4073898635be3fbb8894) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:13.758255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.760068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.767695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 261/534] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/role_assignments?user.id=d0570ef979ab4073898635be3fbb8894&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:13.768679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:13.814477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:13.824601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:13.889676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f5e9-4df8-458b-8af9-38b151591340 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.890645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027774-6d01-4c03-a239-97b672b8ec73 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:13.934699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.935482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.935798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.936077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.948855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.951019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.965413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:13.966172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:13.966449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:13.966718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:13.967435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:13.967802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:13.968195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:13.969060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:13.969922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:13.969922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:13.969922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:13.970088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:13.970154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 262/535] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:13.974986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:14.012230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 274/536] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:14.017871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:14.087087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb7df7-ed11-4808-8ac4-d7b0ea0878d3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:14.096187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:14.128825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:14.129446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:14.129731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:14.130010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:14.130663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:14.131517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:14.133278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:14.151769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 263/537] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:14.153461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:14.239755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f2794-3153-40f6-9f31-5c0a491108f6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:14.283793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:14.289346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:14.289936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:14.290222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:14.290506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:14.291742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=5523644021bf4d91a3a9246bee763b6c) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:14.292072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:14.294175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:14.300709 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 275/538] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:14 2022] GET /identity/v3/role_assignments?user.id=5523644021bf4d91a3a9246bee763b6c&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:14.328496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd265d93-51b8-4f8b-8c17-12a6c041fd1a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:14.386055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:14.387917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:14.388412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:14.388901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:14.400454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:14.403048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:14.423262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:14.424213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:14.425076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:14.427214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 264/539] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:14.433139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:14.571876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0d254-5e5e-4167-b671-a1e205a02db9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:14.617522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ebeba-9ce9-4645-94c6-a0544f529b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:14.618292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebeba-9ce9-4645-94c6-a0544f529b37 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:14.618533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebeba-9ce9-4645-94c6-a0544f529b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:14.618812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ebeba-9ce9-4645-94c6-a0544f529b37 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:14.619622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ebeba-9ce9-4645-94c6-a0544f529b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:14.619933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ebeba-9ce9-4645-94c6-a0544f529b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:14.621944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ebeba-9ce9-4645-94c6-a0544f529b37 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:14.637098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 276/540] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:14.643147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:14.668795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:14.773721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3088f-7253-47d3-bf27-7cbae3d713f6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:14.823070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1eff44-bf43-49ed-8431-05bfb0366c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:14.824068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eff44-bf43-49ed-8431-05bfb0366c89 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:14.824893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eff44-bf43-49ed-8431-05bfb0366c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:14.825169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1eff44-bf43-49ed-8431-05bfb0366c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:14.825903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1eff44-bf43-49ed-8431-05bfb0366c89 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=d053a3f1d07641b586518ae0c0a39e4b) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:14.826209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1eff44-bf43-49ed-8431-05bfb0366c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:14.827669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1eff44-bf43-49ed-8431-05bfb0366c89 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:14.835736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 265/541] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:14 2022] GET /identity/v3/role_assignments?user.id=d053a3f1d07641b586518ae0c0a39e4b&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:15.235473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa915-a5de-4832-aa87-aae20bcd9706 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:15.235839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa915-a5de-4832-aa87-aae20bcd9706 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:15.236045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaa915-a5de-4832-aa87-aae20bcd9706 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:15.237701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 277/542] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:15.243788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0876eb-8154-45d8-ba57-5d17e6fe3c17 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:15.244305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0876eb-8154-45d8-ba57-5d17e6fe3c17 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:15.244305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0876eb-8154-45d8-ba57-5d17e6fe3c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:15.273194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-bc0876eb-8154-45d8-ba57-5d17e6fe3c17 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:15.274415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bc0876eb-8154-45d8-ba57-5d17e6fe3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:15.377855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 266/543] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:15.549881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d38f-5e15-48ff-b88a-090d48e61814 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:15.550244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d38f-5e15-48ff-b88a-090d48e61814 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:15.550445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9d38f-5e15-48ff-b88a-090d48e61814 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:15.551808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 278/544] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:15.557032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2978774-7aea-4dfc-86b7-ddc9cbec7ba2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:15.557560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2978774-7aea-4dfc-86b7-ddc9cbec7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:15.558598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2978774-7aea-4dfc-86b7-ddc9cbec7ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:15.587673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d2978774-7aea-4dfc-86b7-ddc9cbec7ba2 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:15.588848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d2978774-7aea-4dfc-86b7-ddc9cbec7ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:15.590924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:15.663651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 267/545] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:30:15.783949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9d38f-5e15-48ff-b88a-090d48e61814 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:15.848400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:15.908991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9d38f-5e15-48ff-b88a-090d48e61814 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:15.946642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:15.947268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:15.947593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:15.947866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:15.959190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:15.964036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:15.965534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:15.966357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 279/546] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:15.971682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2978774-7aea-4dfc-86b7-ddc9cbec7ba2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.068332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.127164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2978774-7aea-4dfc-86b7-ddc9cbec7ba2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.174594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be3fa-e556-41d2-9dce-598cf3bb1690 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.191005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:16.212389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:16.213015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.213390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.213669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.215104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:16.215797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.216075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.216343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.217056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:16.217367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:16.218783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:16.225205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:16.233070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:16.234003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:16.234898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:16.236667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 280/547] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:16.242160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 268/548] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:16.248429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.249668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.397271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de075d-0daa-41b8-8b29-dfe934e42952 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.451226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:16.451812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da506525-d5e7-4d65-a867-28e329bda318 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.452441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.452917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.453629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.454529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:16.455033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:16.456948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:16.474540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 281/549] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:16.480627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.514884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316ba4-4c67-47da-88ec-7e8b1b719fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:16.515919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316ba4-4c67-47da-88ec-7e8b1b719fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.516510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316ba4-4c67-47da-88ec-7e8b1b719fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.516993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316ba4-4c67-47da-88ec-7e8b1b719fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.529284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316ba4-4c67-47da-88ec-7e8b1b719fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:16.531262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316ba4-4c67-47da-88ec-7e8b1b719fd4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:16.534108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1f316ba4-4c67-47da-88ec-7e8b1b719fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:16.548011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:16.559929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 269/550] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ead1b-e063-42c4-8f09-9a0d46df2726 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ead1b-e063-42c4-8f09-9a0d46df2726 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ead1b-e063-42c4-8f09-9a0d46df2726 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 270/551] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:16.560790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ead1b-e063-42c4-8f09-9a0d46df2726 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.613581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5ef1-8ef1-4abb-8054-55571ea97da1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.617731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:16.652407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2f6cd-8be5-4098-b67c-5cc9ae147ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:16.653069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f6cd-8be5-4098-b67c-5cc9ae147ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.653355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f6cd-8be5-4098-b67c-5cc9ae147ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.653623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f6cd-8be5-4098-b67c-5cc9ae147ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.664332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2f6cd-8be5-4098-b67c-5cc9ae147ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:16.665870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2f6cd-8be5-4098-b67c-5cc9ae147ab5 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:16.670085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ead1b-e063-42c4-8f09-9a0d46df2726 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9be2f6cd-8be5-4098-b67c-5cc9ae147ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:16.686917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:16.688059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:16.689198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:16.689198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:16.689198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:16.689198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 282/552] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:16.690260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582e8fd-23fb-460e-9a6b-fd629d3c7b6e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.691924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582e8fd-23fb-460e-9a6b-fd629d3c7b6e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.692236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582e8fd-23fb-460e-9a6b-fd629d3c7b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.718317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0582e8fd-23fb-460e-9a6b-fd629d3c7b6e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:16.719724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0582e8fd-23fb-460e-9a6b-fd629d3c7b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:16.720407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:16.721250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.721912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.722375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.723305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:16.723877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:16.725562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:16.739153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 271/553] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:16.740546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.838677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 283/554] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:16.839714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582e8fd-23fb-460e-9a6b-fd629d3c7b6e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:16.857696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:16.861502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365060af-8ff3-4481-88fb-59e9cbe7e782 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.889709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:16.951916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:16.952755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:16.952882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:16.953057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:16.953707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:16.954006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:16.955351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:16.967717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582e8fd-23fb-460e-9a6b-fd629d3c7b6e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:16.981352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 272/555] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:16.986382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.012422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73c737-fe6a-4eec-b7d2-681217f38904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.013066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c737-fe6a-4eec-b7d2-681217f38904 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.013345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c737-fe6a-4eec-b7d2-681217f38904 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.013614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c737-fe6a-4eec-b7d2-681217f38904 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.025226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73c737-fe6a-4eec-b7d2-681217f38904 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:17.027815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73c737-fe6a-4eec-b7d2-681217f38904 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ec73c737-fe6a-4eec-b7d2-681217f38904 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:17.041015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:17.042195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:17.043304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:17.048290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 284/556] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:17.049630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87925655-4530-4545-94ad-c8ab14be657c None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.049990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87925655-4530-4545-94ad-c8ab14be657c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.050337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87925655-4530-4545-94ad-c8ab14be657c None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.052228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 285/557] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:17.052794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87925655-4530-4545-94ad-c8ab14be657c None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.124189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72be3f9-ea77-4a3b-b9ba-ca516597be76 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.139198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:17.161247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f1fc-a7ba-4ac9-b6f0-4a3e31555ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.161840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f1fc-a7ba-4ac9-b6f0-4a3e31555ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.162174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f1fc-a7ba-4ac9-b6f0-4a3e31555ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.162486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f1fc-a7ba-4ac9-b6f0-4a3e31555ca0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.168218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87925655-4530-4545-94ad-c8ab14be657c None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.170354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f1fc-a7ba-4ac9-b6f0-4a3e31555ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:17.171821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f1fc-a7ba-4ac9-b6f0-4a3e31555ca0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-e882f1fc-a7ba-4ac9-b6f0-4a3e31555ca0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:17.184243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:17.185696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 273/558] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:30:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:17.186641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bfaa-25b0-4a79-aaef-11da6eeceefb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.187311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bfaa-25b0-4a79-aaef-11da6eeceefb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.187311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834bfaa-25b0-4a79-aaef-11da6eeceefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.204709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f834bfaa-25b0-4a79-aaef-11da6eeceefb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:17.205950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f834bfaa-25b0-4a79-aaef-11da6eeceefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:17.209898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.210502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.210806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.211051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.211819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:17.212123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:17.213566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:17.233147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 286/559] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:17.233954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.239747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:17.287612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 274/560] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:17.287612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834bfaa-25b0-4a79-aaef-11da6eeceefb None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.358810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ff9d-c650-4bfb-98ab-d9e2c5004e7c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.398144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:17.404978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.405345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.405635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.405913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.416258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:17.420201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834bfaa-25b0-4a79-aaef-11da6eeceefb None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:17.421126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:17.422066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:17.422918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 287/561] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:17.423674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.471979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.472520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.472804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.473080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.473814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:17.474111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:17.475556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:17.493687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 275/562] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:17.494490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.518468 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:17.538970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5faaa-d060-4deb-9ec0-338a5a1672e6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.574529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.575136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.575438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.575709 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.601075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda5ba1-4c1f-4e6f-918f-59da6bd92091 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.633851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:17.637581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed9b8-85a0-4d6a-b746-d9afd70f773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.638200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed9b8-85a0-4d6a-b746-d9afd70f773a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.638483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed9b8-85a0-4d6a-b746-d9afd70f773a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.638755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed9b8-85a0-4d6a-b746-d9afd70f773a None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.639441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ed9b8-85a0-4d6a-b746-d9afd70f773a None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:17.639822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ed9b8-85a0-4d6a-b746-d9afd70f773a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:17.646617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ed9b8-85a0-4d6a-b746-d9afd70f773a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:17.646735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:17.646735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:17.649185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 276/563] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:17.650425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428e5a7-397b-4a89-99f2-4ee26da696e3 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.650715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428e5a7-397b-4a89-99f2-4ee26da696e3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.650992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428e5a7-397b-4a89-99f2-4ee26da696e3 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.655577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 277/564] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:17.655577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428e5a7-397b-4a89-99f2-4ee26da696e3 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.747102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 288/565] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:17.747975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.775788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:17.793629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428e5a7-397b-4a89-99f2-4ee26da696e3 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.828422 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.829045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.829325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.829602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.835650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:17.839583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:17.841111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:17.844390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f6df-6952-48bc-919a-912dbe5ff009 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:17.855230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:17.856261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:17.857159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:17.857159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:17.857159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:17.857159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 278/566] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:17.857159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:17.884284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa5fc4-6ccf-457c-93f1-eba80a9ccfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:17.884937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5fc4-6ccf-457c-93f1-eba80a9ccfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.885213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5fc4-6ccf-457c-93f1-eba80a9ccfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.885485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa5fc4-6ccf-457c-93f1-eba80a9ccfe3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.896371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa5fc4-6ccf-457c-93f1-eba80a9ccfe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-0ffa5fc4-6ccf-457c-93f1-eba80a9ccfe3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:17.901220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:17.902592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:17.903470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 289/567] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:17.904181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa725d-ded4-43c8-9545-07b46cdd8705 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:17.904181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa725d-ded4-43c8-9545-07b46cdd8705 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:17.904181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa725d-ded4-43c8-9545-07b46cdd8705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:17.924750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-36fa725d-ded4-43c8-9545-07b46cdd8705 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:17.925948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-36fa725d-ded4-43c8-9545-07b46cdd8705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:17.961318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d49607-5956-49dc-b33a-244a1a987a5f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:17.991044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 290/568] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:17.991903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa725d-ded4-43c8-9545-07b46cdd8705 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.006597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.007326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.007634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.007912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.009868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.019772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.026797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:18.035153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:18.036224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:18.037136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:18.037136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:18.037136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:18.037136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 279/569] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:18.037136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.080588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.099015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa725d-ded4-43c8-9545-07b46cdd8705 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.134146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.134778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.135060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.135334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.146940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.147776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b1b6-52ba-47af-9483-58a9537c3cf7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.148429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:18.162815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:18.163807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:18.164707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:18.164707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:18.164707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:18.164707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 291/570] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:18.164707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.190365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.191036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.191321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.191625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.192697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:18.193264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.194647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.210578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 280/571] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:18.210578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.257858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.278718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7478368-f5bb-455a-bed8-cafec87e790f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.310634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46c90-9701-4698-9b2c-2fda024add3a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.312840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.313445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.313724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.313995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.314651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:18.314951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.316346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.317674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.325267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 292/572] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:18.326054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.346916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.347539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.347824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.348098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.348737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:18.349040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.350384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.361851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 281/573] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:18.362636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.428084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1d38-a188-4ffa-a434-189c583ab759 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.460318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.460917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.461190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.461459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.462087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:18.462384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.462474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848e82c-817c-4eb9-aaeb-5f85992219eb None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.463763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.470400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.475135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 293/574] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:18.475955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.498402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.499029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.499309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.499619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.506835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.508355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:18.519513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:18.520400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:18.521277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 282/575] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:18.521749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.533073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.576566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb023-3c04-4744-a324-bf99137b538a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.609758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.610372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.610647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.610917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.621115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:18.622555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8691-e4e8-46bc-a335-da56869bbcb9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:18.626241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:18.627317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 294/576] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:18.628216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.656415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.657045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.657332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.657610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.667860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.669362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:18.684038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:18.685178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:18.686277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:18.686277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:18.686277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:18.686277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 283/577] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:18.686277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.708056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.737102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dbf55-739b-4888-abcc-c9bdd8f166ab None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.795233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.810224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13d0d3-0c18-4635-87ec-f394b49a67ed None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.812493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.813114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.813388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.813654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.820806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.822321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:18.833773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:18.834978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 295/578] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:18.836226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.846441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.847089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.847369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.847668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.854695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.856883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:18.867848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:18.868918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:18.869907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 284/579] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:18.870471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:18.941093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f06c9b-654f-44d5-b84b-e39d5b9ea05f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.948184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:18.969188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bee34f-5e4b-4ced-8b24-ece32e6ef06d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:18.974106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:18.974700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:18.974976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:18.975243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:18.975968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:18.976269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:18.977686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:18.990340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 296/580] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:18.991131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.002952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.003585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.003864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.004140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.004792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:19.005092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.006417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.014933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 285/581] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:19.015750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.030081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:19.094257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc958-fc3a-43c4-9649-8a3b18ccfc77 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.117087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41e627-9047-475f-9eeb-c0db1cd80eac None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.128072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.128675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.128955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.129227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.129868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:19.130170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.131575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.143428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 297/582] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:19.144251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.156653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.157262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.157549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.157828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.158554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:19.158862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.160300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.170352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:19.178462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 286/583] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:19.179233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.235639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:19.241196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319614-7a9e-407b-9f88-50dedb62138d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.275808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.276399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.277211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.277614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.278296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:19.278593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.278684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815798ce-153c-496c-8044-9e200c39e6b4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.280050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.291062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 298/584] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:19.292949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.318523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.319170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.319487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.319764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/0969ec55ae1244c09694079a72bf8310/roles/6288c02347fc4743b28fbb9e17d55542` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.333344 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=0969ec55ae1244c09694079a72bf8310, role_id=6288c02347fc4743b28fbb9e17d55542)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.334744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.390303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edf536-b116-42c8-bf81-791b8499263a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.410093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 287/585] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:19 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/0969ec55ae1244c09694079a72bf8310/roles/6288c02347fc4743b28fbb9e17d55542 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:19.410996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.426637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.427295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.427604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.427881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.439831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.441314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:19.456500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:19.457697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:19.458797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:19.458797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:19.458797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:19.462258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 299/586] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:19.463216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.476237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:19.486251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:19.544185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6114474-fd11-458d-865d-82036cc89739 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.581186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.581833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.582113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.582385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.593403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.594843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.597882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea007c2-25a6-437c-8ce7-01da8ae12e3d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:19.609235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:19.610352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 08:30:19.611471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:19.613331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 288/587] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:19.614237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.634735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.635478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.635770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.636570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.647676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.649584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:19.664362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:19.665515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:19.666413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:19.666413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:19.666413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:19.666413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 300/588] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:19.666413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.727071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:19.732028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78c875-1546-468d-89fa-f3e27ce68e2b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.741268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:19.767864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.768577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.768856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.769129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.769847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=6717f091388748d8aad2eafcb50fd61a) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:19.770153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.771364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c7c81-a943-4d53-9ffe-0d219a7df412 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.771582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.777671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 289/589] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/role_assignments?user.id=6717f091388748d8aad2eafcb50fd61a&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:19.778747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.810657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.811280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.811633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.811903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.812755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:19.813059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.814866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:19.837889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 301/590] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:19.840884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:19.944515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209b129-094b-43c7-88d9-039959665d85 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.975571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a017f-05bb-4cab-b0a6-7c6f3880425e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:19.988860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597215-a2f4-4582-a143-326a00681594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:19.989479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597215-a2f4-4582-a143-326a00681594 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:19.989759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597215-a2f4-4582-a143-326a00681594 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:19.990182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597215-a2f4-4582-a143-326a00681594 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:19.991051 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597215-a2f4-4582-a143-326a00681594 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:19.991358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597215-a2f4-4582-a143-326a00681594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:19.992793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597215-a2f4-4582-a143-326a00681594 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.002701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.016744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.017838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 290/591] 10.222.0.57 () {56 vars in 1139 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:20.018229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.018698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.018821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597215-a2f4-4582-a143-326a00681594 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.019367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.020205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:20.025105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.025105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.039183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 302/592] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:20.040562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.058002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.138519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597215-a2f4-4582-a143-326a00681594 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.181545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.181934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a3ab6-1012-4527-9687-e62481505ab1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.182839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.183647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.184142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.194597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.196658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:20.211764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:20.212802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:30:20.213790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:20.221335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 291/593] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:20.221335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.224045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.224809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.225085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.225349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.237829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.239438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:20.254856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:20.255897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:20.256804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:20.256804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:20.256804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:20.259568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 303/594] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:20.260413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.304206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.333831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.348971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a28a18-0233-402c-9151-058676c49502 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.381259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f923e1-a681-4acd-84f6-6e8dc14c4de3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.393964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.395204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.395667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.396411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.405172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.406784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:20.420672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:20.421819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:20.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:20.424053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.424730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.425088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.429874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.429874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:20.429874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.429874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.430611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 292/595] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:20.432308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.455687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 304/596] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:20.456694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.556902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e26bd-d617-4b05-94c7-91f70f1d51f8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.559274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.571326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2821-e8ac-46cb-b289-0a2d90cf4a6e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.599561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.600186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.600491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.600794 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.601451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:20.601756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.603179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.615312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.616244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.616524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 293/597] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:20.616956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.617432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.617545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.618478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:20.618985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.621860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.630993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.641653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 305/598] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:20.641653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.747797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35cd6a-f089-4c4e-a54c-0db6affb60ea None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.758291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a0cf1-5687-4853-ad83-903736c44a55 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.795577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.796542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.796962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.797301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.799596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:20.800841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:20.801313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:20.801773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:20.804844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.806357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.815163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:20.816874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:20.818721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:20.819708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 306/599] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:20.820612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.837952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:20.838190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:20.839315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:20.840499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:20.840499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:20.840499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:20.847554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 294/600] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:20.848363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:20.931687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:20.957512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f09641-69fd-48cd-afb6-8d7b9e7b855f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:20.972421 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1137e2-c250-4495-88dc-84701a5d1ca4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:21.004223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:21.004803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.005234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.005578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/d0570ef979ab4073898635be3fbb8894/roles/6288c02347fc4743b28fbb9e17d55542` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.012981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:21.013824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.014310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.014767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.015676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:21.016782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:21.019010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:21.022548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=d0570ef979ab4073898635be3fbb8894, role_id=6288c02347fc4743b28fbb9e17d55542)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:21.024166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:21.034279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 295/601] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:21.035526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:21.109425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 307/602] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:20 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/d0570ef979ab4073898635be3fbb8894/roles/6288c02347fc4743b28fbb9e17d55542 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:21.110718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:21.185170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f230-c09f-407b-9d01-9cf2115923ec None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:21.231057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:21.239453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:21.256373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:21.257311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.257807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.258310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.259160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:21.259670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:21.262509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:21.294601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 296/603] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:21.295769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:21.305040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67a8e-3151-4cad-9d8e-738aee62c23e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:21.348880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:21.349858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.350355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.350821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/5523644021bf4d91a3a9246bee763b6c/roles/6288c02347fc4743b28fbb9e17d55542` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.371593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=5523644021bf4d91a3a9246bee763b6c, role_id=6288c02347fc4743b28fbb9e17d55542)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:21.373825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:21.448217 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38783e6-06fc-43f6-a0e8-99fbc1c6f013 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:21.479519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 308/604] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:21 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/5523644021bf4d91a3a9246bee763b6c/roles/6288c02347fc4743b28fbb9e17d55542 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:21.487166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:21.487166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.487166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.487166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.494717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:21.497089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:21.510504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:21.512613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:21.513520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 297/605] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:21.520473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:21.674662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520160-2ed9-458a-a4ea-9fa444243911 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:21.691782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:21.725800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019f73a-9c53-450b-9155-6e9f6623d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:21.726440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019f73a-9c53-450b-9155-6e9f6623d985 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.726721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019f73a-9c53-450b-9155-6e9f6623d985 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.726994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019f73a-9c53-450b-9155-6e9f6623d985 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.727875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019f73a-9c53-450b-9155-6e9f6623d985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:21.728190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019f73a-9c53-450b-9155-6e9f6623d985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:21.729837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019f73a-9c53-450b-9155-6e9f6623d985 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:21.746862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 309/606] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:21.753677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:21.824172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:21.858645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c9f85-0b34-4e3c-b471-a4dc37aaae45 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.859283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c9f85-0b34-4e3c-b471-a4dc37aaae45 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.859794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c9f85-0b34-4e3c-b471-a4dc37aaae45 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.862646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 310/607] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:30:21.867082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496520-d5a7-4641-a95c-4f6b21d24a85 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.867651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496520-d5a7-4641-a95c-4f6b21d24a85 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.868170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0496520-d5a7-4641-a95c-4f6b21d24a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.887836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f0496520-d5a7-4641-a95c-4f6b21d24a85 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:21.889449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f0496520-d5a7-4641-a95c-4f6b21d24a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:21.894181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02358a-b5f5-4625-bfdf-849410af4136 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:21.954600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:21.955239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:21.955558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:21.955838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/d053a3f1d07641b586518ae0c0a39e4b/roles/6288c02347fc4743b28fbb9e17d55542` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:21.985573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=d053a3f1d07641b586518ae0c0a39e4b, role_id=6288c02347fc4743b28fbb9e17d55542)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:21.987984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:22.014986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 311/608] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:22.024036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2e11-e78a-40af-b10f-5fdf89fc5772 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:22.024381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2e11-e78a-40af-b10f-5fdf89fc5772 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:22.024660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2e11-e78a-40af-b10f-5fdf89fc5772 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:22.026199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 312/609] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:30:22.032487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbabb8-e126-483a-aeac-ea0d7fda305c None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:22.032777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbabb8-e126-483a-aeac-ea0d7fda305c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:22.033056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbabb8-e126-483a-aeac-ea0d7fda305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:22.052935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b1cbabb8-e126-483a-aeac-ea0d7fda305c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:22.054120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b1cbabb8-e126-483a-aeac-ea0d7fda305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:22.073945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 298/610] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:21 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/d053a3f1d07641b586518ae0c0a39e4b/roles/6288c02347fc4743b28fbb9e17d55542 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:22.164791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 313/611] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 28 08:30:22.337776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:22.440431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:22.450082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf1559-3ff8-45d0-a5c2-8b487fa98b5a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:22.487451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:22.488095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:22.488637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:22.488911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:22.501650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbabb8-e126-483a-aeac-ea0d7fda305c None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:22.503498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:22.508330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:22.509292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:22.510157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 299/612] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:22.515907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:22.556861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:22.692868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbabb8-e126-483a-aeac-ea0d7fda305c None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:22.711638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f17874-b9d0-4faa-b62c-c81f4b4160e4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:22.759785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:22.760420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:22.760700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:22.762108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:22.778178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:22.778789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:22.779073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:22.779349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:22.780050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:22.780357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:22.781717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:22.783523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:22.788528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:22.789466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:22.790292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:22.791503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 314/613] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:22.800735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:22.806297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 300/614] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:22.809702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:22.838800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:22.988694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:22.993632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49956e-ac59-4a80-b096-e84e34da7064 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:23.008814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c1ec8-47af-4ab6-a729-17078bdc08b1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:23.056314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:23.056953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:23.057236 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:23.057513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:23.070215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:23.070815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:23.071098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:23.071372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:23.072061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:23.072364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:23.074007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:23.079689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:23.081127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:23.093746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 315/615] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:23.100097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:23.105997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:23.106932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:23.108191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:23.108191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:23.108191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:23.108191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 301/616] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:23.115108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:23.234413 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:23.278965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89449ff3-cc04-46df-a3c1-bc1299da9235 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:23.299901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa64e4-a552-49d4-9c4c-3a45597c7af0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:23.321206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:23.321843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:23.322124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:23.322396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:23.333575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:23.335040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:23.351500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:23.352537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:23.353906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:23.353906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:23.353906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:23.353906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 316/617] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:23.363083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:23.375756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:23.393216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:23.393831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:23.394164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:23.394365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:23.395027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:23.395329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:23.396719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:23.426762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 302/618] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:23.434663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:23.523081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b671-03b7-4e9b-be37-d92ea848f02c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:23.562809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:23.563343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:23.563652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:23.563926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:23.564571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:23.564873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:23.566312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:23.580682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 317/619] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:23.586603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:23.649350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12bfc8-727c-438d-a6e8-3ca39766a4e2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:23.658280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:23.693557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:23.706676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22a28-64e8-4f59-b994-166728973c06 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:23.715618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:23.716266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:23.716548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:23.716822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:23.728745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:23.730337 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:23.754580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:23.755683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:23.756673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:23.759772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 303/620] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:30:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:23.770124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:23.780634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:23.781550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:23.785529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:23.785961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:23.798161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:23.802151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:23.825536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:23.826747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:23.827971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:23.835278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 318/621] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:23.842627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:23.993972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b1b0c-dba7-4d3e-ba67-01b08fb8cad2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.032072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a5f81-2aeb-4aaf-8f47-462959db0ad9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.035590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e36b6f-b765-4ac5-90bf-0b9733ab8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.040541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e36b6f-b765-4ac5-90bf-0b9733ab8729 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.040937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e36b6f-b765-4ac5-90bf-0b9733ab8729 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.041315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e36b6f-b765-4ac5-90bf-0b9733ab8729 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.042684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e36b6f-b765-4ac5-90bf-0b9733ab8729 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:24.043323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e36b6f-b765-4ac5-90bf-0b9733ab8729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:24.045182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e36b6f-b765-4ac5-90bf-0b9733ab8729 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:24.060752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:24.071593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 304/622] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:30:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:24.071593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0dda-1903-4caa-bcd6-dbaf012cddfc None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.071593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0dda-1903-4caa-bcd6-dbaf012cddfc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.071593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b0dda-1903-4caa-bcd6-dbaf012cddfc None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.071593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 305/623] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:24.077055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6f58-4576-4a9c-9a56-e7f11c747781 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.077055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6f58-4576-4a9c-9a56-e7f11c747781 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.077055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6f58-4576-4a9c-9a56-e7f11c747781 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.077055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 306/624] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:30:24.077055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e6f58-4576-4a9c-9a56-e7f11c747781 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.081928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caf6fd-de54-4880-8ddd-8b884fcc6ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.082539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caf6fd-de54-4880-8ddd-8b884fcc6ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.082873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caf6fd-de54-4880-8ddd-8b884fcc6ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.083146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caf6fd-de54-4880-8ddd-8b884fcc6ca8 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.083955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06caf6fd-de54-4880-8ddd-8b884fcc6ca8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:24.084262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06caf6fd-de54-4880-8ddd-8b884fcc6ca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:24.085670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06caf6fd-de54-4880-8ddd-8b884fcc6ca8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:24.107485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 319/625] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 28 08:30:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:24.107485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1988d-a293-4723-9b63-7b99b4d58473 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.107485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1988d-a293-4723-9b63-7b99b4d58473 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.107485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1988d-a293-4723-9b63-7b99b4d58473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.125791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-30e1988d-a293-4723-9b63-7b99b4d58473 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:24.126961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-30e1988d-a293-4723-9b63-7b99b4d58473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:24.140391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:24.207451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 320/626] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:24.207451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6588d28-c2cc-44e3-bd99-83e44edea15e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.207451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6588d28-c2cc-44e3-bd99-83e44edea15e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.207451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6588d28-c2cc-44e3-bd99-83e44edea15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.208811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e6f58-4576-4a9c-9a56-e7f11c747781 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.223700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c6588d28-c2cc-44e3-bd99-83e44edea15e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:24.224870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c6588d28-c2cc-44e3-bd99-83e44edea15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:24.249115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.249723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.249999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.250269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.308773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 321/627] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:24.309981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6588d28-c2cc-44e3-bd99-83e44edea15e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.333077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:24.335412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:24.382870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:24.416126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:24.509681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6588d28-c2cc-44e3-bd99-83e44edea15e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.525826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 307/628] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:24.531711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.568930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.569769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.570066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.570344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.586013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:24.588450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:24.611244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:24.612553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:24.613666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:24.613666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:24.613666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:24.614149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 322/629] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:24.614781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.658269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b47ee-8ac7-49cc-b319-3cb84364845e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.694997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.695656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.696103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.696375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.707075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:24.708589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:24.711113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:24.715833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:24.722298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a998-ac93-4622-b865-9a2534d7f4a8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:24.723774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:24.724857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:24.725844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:24.725844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:24.725844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:24.725844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 308/630] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:24.725844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.757493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.758170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.758443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.758710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.769631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:24.775889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:24.783765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 323/631] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:24.784808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.835885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9e90-a34a-4edf-ba1c-5232748a1d10 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.868754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41948461-4da4-4b22-acc1-0125f6987dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.869293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41948461-4da4-4b22-acc1-0125f6987dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.869602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41948461-4da4-4b22-acc1-0125f6987dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.869874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41948461-4da4-4b22-acc1-0125f6987dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.871275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41948461-4da4-4b22-acc1-0125f6987dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:24.871618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41948461-4da4-4b22-acc1-0125f6987dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:24.872982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41948461-4da4-4b22-acc1-0125f6987dc6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:24.878113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94080fb3-56e3-4338-81b9-8e316b32328d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:24.884450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 309/632] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:24.885618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e187c-986d-4cf7-9a23-9533f9dcf3ba None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.885938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e187c-986d-4cf7-9a23-9533f9dcf3ba None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.886436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e187c-986d-4cf7-9a23-9533f9dcf3ba None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.891557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 310/633] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:24.891557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e187c-986d-4cf7-9a23-9533f9dcf3ba None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.914468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:24.915100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:24.915383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:24.915693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:24.929303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:24.935035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:24.936393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 324/634] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:24.937347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:24.955775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:24.956699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.000726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e187c-986d-4cf7-9a23-9533f9dcf3ba None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.035323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.035954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.036240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.036512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.037151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:25.037452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.038818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.041912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bd3c2-a0b8-4662-be77-09dbe096fe59 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.050397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 311/635] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:25.051125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.078737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b252f-7bfb-4933-894e-6511b7381d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.079337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b252f-7bfb-4933-894e-6511b7381d01 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.079638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b252f-7bfb-4933-894e-6511b7381d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.079918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b252f-7bfb-4933-894e-6511b7381d01 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.080568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b252f-7bfb-4933-894e-6511b7381d01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:25.080863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b252f-7bfb-4933-894e-6511b7381d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.082221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b252f-7bfb-4933-894e-6511b7381d01 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.090261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 325/636] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:25.091462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116687-b0b3-4be2-87b5-852b235690a1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.091741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116687-b0b3-4be2-87b5-852b235690a1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.092017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116687-b0b3-4be2-87b5-852b235690a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.109585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-27116687-b0b3-4be2-87b5-852b235690a1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:25.110752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-27116687-b0b3-4be2-87b5-852b235690a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:25.153529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286b29-62f2-4b1c-9812-4b28d77fadee None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.169840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.177912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 326/637] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:25.178758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116687-b0b3-4be2-87b5-852b235690a1 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.186712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.187319 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.187640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.187914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.194327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.194454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.195914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:25.208315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:25.210099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 312/638] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:25.210993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.298856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116687-b0b3-4be2-87b5-852b235690a1 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.320188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692528-aec2-4d21-b495-6e7376424131 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.333396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.333988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.334451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.334559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.335216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:25.335498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.336846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.349549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 327/639] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:25.349549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.361553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.362194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.362476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.362753 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.370232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.371807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:25.383454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:25.384353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:25.385271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 313/640] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:25.385808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.423005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.423965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.459110 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdedbf6-f32a-4041-9ca9-fdad0a7078e3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.491748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52618ff2-f67e-43d3-98fc-ac629f6ceddd None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.493514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.494142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.494415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.494690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.505211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.506637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:25.520998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:25.522228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:25.523388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:25.523388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:25.523388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:25.523388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 328/641] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:25.523388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.528659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.529274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.529550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.529821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.530507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:25.530811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.532251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.543991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 314/642] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:25.544774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.628246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3e8ca-ede0-4183-b899-ba5a8c432201 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.633862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.640881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655bcb4-be13-4209-a98c-941182a38054 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.648126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.662676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.663306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.663616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.663889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.674866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.675448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.676059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.676278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.676382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.676596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.677274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:25.677575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.678967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.690768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 315/643] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:25.691275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:25.692255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:25.693316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:25.693316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:25.693316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:25.693498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.693568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 329/644] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:25.693568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.791649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad9693-93ed-4ba4-ac0f-ea076bb5829a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.794065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00769-9cb2-4ddf-a1da-246d7a3a7164 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.825431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.826030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.826309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.826583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.827210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:25.827533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.827702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.828325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.828605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.828874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.828962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.838720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:25.841015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 330/645] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:25.841790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:25.844054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:25.845284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 316/646] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:25.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:25.865788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.877001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:25.946826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c348584-9313-48b3-85d1-46c897f40723 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.946995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69574-5608-4a23-859b-660809d984c3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:25.979979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.980534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:25.980651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.980830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.981100 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.981193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:25.981439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:25.981711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/6717f091388748d8aad2eafcb50fd61a/roles/6288c02347fc4743b28fbb9e17d55542` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:25.981811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=0969ec55ae1244c09694079a72bf8310) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:25.982107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:25.983538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:25.989093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 317/647] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/role_assignments?user.id=0969ec55ae1244c09694079a72bf8310&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:25.989874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.008602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=6717f091388748d8aad2eafcb50fd61a, role_id=6288c02347fc4743b28fbb9e17d55542)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.010101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.081746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:26.095465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 331/648] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:25 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/6717f091388748d8aad2eafcb50fd61a/roles/6288c02347fc4743b28fbb9e17d55542 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:26.095465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.121130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c12df-1672-4745-99c6-fd94c14f5dae None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.160479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.161267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.161919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.162268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.163022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:26.163401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.164969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.181793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 318/649] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:26.183592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.229051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:26.257034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650bce9-132b-45eb-b0d3-56dfe7bec512 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.303747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.304393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.304729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.305012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.315653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.317115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:26.330391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:26.331385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:26.332413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 332/650] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:26.333029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.337127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b91c-a4c1-4322-9a59-cc48c40ff7d4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.380003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.381182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.381639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.382189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.383171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:26.383492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.384852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.395454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 319/651] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:26.396305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.399935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:26.452593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b123ab2-9686-44ab-a329-01ae6b48c480 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.494686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.496508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.497003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.497551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.506411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.508334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:26.522093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:26.523091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 28 08:30:26.524404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:26.527557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 333/652] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:26.528607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.529339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b83df-49db-433b-9852-da95df0360a3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.533511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:26.574535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.575152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.575474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.575720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.576447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:26.577162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.578901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.603231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 320/653] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:26.605066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.652342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75123aa0-d4a9-488c-ad6e-c264a6d073e7 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.671989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:26.694417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.695407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.695717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.696243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.710569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.712380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.720031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec722c-b5eb-4fd4-afa1-7393fd3b8851 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:26.732139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:26.733090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:26.734398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:26.734398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:26.734398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:26.734398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 334/654] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:26.734808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.756699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.756699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.756699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.756699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.757073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:26.757073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.757073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.776912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 321/655] 10.222.0.57 () {56 vars in 1139 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:26.778255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:26.805471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:26.870778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca665-ea50-4394-a24c-0d021b181d0a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.887737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fd2ee-6988-4ef1-8836-025784712a60 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:26.907837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:26.919459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.925754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.925754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.925754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.935582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:26.936740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:26.937271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:26.937640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:26.938489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:26.938896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:26.940525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:26.958333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 322/656] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:26.959411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.006593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.008495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.069808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8d80f-6d93-4d48-8f7f-21c665248d4e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:27.070498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:27.106751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:27.107498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:27.107920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:27.108271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:27.121350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 335/657] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:27.122248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.160974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:27.184947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.186505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.225057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517fd5f-a716-446b-81c5-154bfa40e3a2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:27.264226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:27.265131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:27.265597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:27.266050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:27.274109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.275821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:27.289103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:27.290087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:30:27.291044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:27.293363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 336/658] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:27.294448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.298816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 323/659] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:27.299886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.312422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:27.381015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:27.401950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34321364-aa79-441b-955a-067a5a0d4316 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:27.408516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee680e99-2ae5-453e-8568-721c889c85e1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:27.438144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:27.438868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:27.439216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:27.439601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:27.440397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:27.440772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.442261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.456395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:27.457305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:27.458419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:27.458875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:27.461212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 324/660] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:27.466917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.472169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.473817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:27.494075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:27.495658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:27.496591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:27.496591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:27.496591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:27.501711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 337/661] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:27.501711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.572043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:27.606852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897008b-b078-4d69-8ba0-e12c5c790af1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:27.610282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dd340-fe33-4172-b535-1d3f45724358 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:27.643612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:27.644324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:27.644673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:27.645014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:27.652528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:27.653582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:27.654077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:27.654527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:27.657578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:27.666966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.668939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:27.686171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:27.687125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:27.688060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:27.688060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:27.688060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:27.695778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 325/662] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:27.696492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.727090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.728677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.801985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:27.825651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a0332-8fb9-4b6c-889f-db9de829e564 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:27.852613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 338/663] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 28 08:30:27.853468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.867834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:27.868700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:27.868813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:27.869082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:27.869732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:27.870745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:27.872281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:27.887264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 326/664] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:27.892281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:27.962363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.000808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12f39d-cc38-4eb2-9cc7-1df72e003320 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.026542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf1a6-1e2f-4f0e-8076-06eca048c222 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.048224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51551366-3790-417d-99a7-21b677c47652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.049204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51551366-3790-417d-99a7-21b677c47652 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.049663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51551366-3790-417d-99a7-21b677c47652 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.050112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51551366-3790-417d-99a7-21b677c47652 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.051387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51551366-3790-417d-99a7-21b677c47652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:28.052215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51551366-3790-417d-99a7-21b677c47652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.054489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51551366-3790-417d-99a7-21b677c47652 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.067757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.068490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.068846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.069193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.070381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 339/665] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:28.071375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51551366-3790-417d-99a7-21b677c47652 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.087442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.089585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.105832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:28.109526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:28.110453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:28.111362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:28.111362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:28.111362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:28.115395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 327/666] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:28.116287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.192633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51551366-3790-417d-99a7-21b677c47652 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.228310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.229026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.229581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.229910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.233003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.236998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a868d0-71ff-4789-bb6b-ab6164955e25 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.237609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.239171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:28.252554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:28.253565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:28.254526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:28.258713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 340/667] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:28.260214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.286863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.287933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.288449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.288905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.298779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.300816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:28.314210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:28.315341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:28.316267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:28.318982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 328/668] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:28.319984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.374561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.394570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ad45-40aa-4ee6-89b3-7adcd75dcd15 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.430060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.430654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.430931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.431200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.431865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:28.432163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.433576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2043a6c-77b6-457b-b968-b2516dc733e8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.434196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.445570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 341/669] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:28.446181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.467249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519856c-596a-4ea5-a92b-184847b3a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.467883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519856c-596a-4ea5-a92b-184847b3a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.468159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519856c-596a-4ea5-a92b-184847b3a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.468429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519856c-596a-4ea5-a92b-184847b3a0b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.469114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519856c-596a-4ea5-a92b-184847b3a0b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:28.469417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519856c-596a-4ea5-a92b-184847b3a0b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.470823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519856c-596a-4ea5-a92b-184847b3a0b1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.483884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 329/670] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:28.485085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb19e-ca19-42c6-a9f4-46352fe49789 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.485368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb19e-ca19-42c6-a9f4-46352fe49789 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.485637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbb19e-ca19-42c6-a9f4-46352fe49789 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.491177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 330/671] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:28.491177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f89d-e536-409c-968b-ceec99a4a862 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.491177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f89d-e536-409c-968b-ceec99a4a862 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.491177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f89d-e536-409c-968b-ceec99a4a862 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.491177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 331/672] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:28.491177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f89d-e536-409c-968b-ceec99a4a862 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.512561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.551513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c5e15-5c9f-49fd-a1b1-376d22e2c316 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.584152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.584748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.585027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.585299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.585982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:28.586285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.587745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.590525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f89d-e536-409c-968b-ceec99a4a862 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.599743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 342/673] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:28.600533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.612786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.626713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f716c-93bf-4c6e-a3b9-f5b807679690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.627793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f716c-93bf-4c6e-a3b9-f5b807679690 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.628247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f716c-93bf-4c6e-a3b9-f5b807679690 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.628699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f716c-93bf-4c6e-a3b9-f5b807679690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.638995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f716c-93bf-4c6e-a3b9-f5b807679690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.641529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f716c-93bf-4c6e-a3b9-f5b807679690 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-aa4f716c-93bf-4c6e-a3b9-f5b807679690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:28.659511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:28.660399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:28.661317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:28.661807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 332/674] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:28.662856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4f1f-5218-4567-add7-3ef11584fa9b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.663200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4f1f-5218-4567-add7-3ef11584fa9b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.663554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4f1f-5218-4567-add7-3ef11584fa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.681035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ecfb4f1f-5218-4567-add7-3ef11584fa9b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:28.682220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ecfb4f1f-5218-4567-add7-3ef11584fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:28.722155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8776-ddc4-4c6c-b580-61046051becd None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.750617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 333/675] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:28.751866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef8309-72ea-4808-8640-2dbbf8f82fbc None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.752153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef8309-72ea-4808-8640-2dbbf8f82fbc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.752428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef8309-72ea-4808-8640-2dbbf8f82fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.756074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:28.756895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:28.757344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:28.757788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:28.759621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=d0570ef979ab4073898635be3fbb8894) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:28.759908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:28.761732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:28.767776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 343/676] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/role_assignments?user.id=d0570ef979ab4073898635be3fbb8894&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:28.770705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ecef8309-72ea-4808-8640-2dbbf8f82fbc None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:28.771942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ecef8309-72ea-4808-8640-2dbbf8f82fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:28.773043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.775728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.867450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 334/677] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:28.867450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef8309-72ea-4808-8640-2dbbf8f82fbc None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:28.891540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:28.965283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc040b76-40c2-447f-b120-9b3e3e4f734b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:28.983090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef8309-72ea-4808-8640-2dbbf8f82fbc None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.007051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.008028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.008507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.008975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.009936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=5523644021bf4d91a3a9246bee763b6c) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:29.010451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.013023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.020816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 344/678] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/role_assignments?user.id=5523644021bf4d91a3a9246bee763b6c&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:29.029448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.029658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.030584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.031194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.031726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.032993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:29.034491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.036259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.049647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:29.054589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 335/679] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:29.062024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.172121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb4216-5e63-4c03-86e9-66ade7a1c14e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.207660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104eb879-d6f1-4786-8d2a-bc3c032192ec None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.215039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.216493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.216995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.217464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.219955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:29.231576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:29.236441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:29.238196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 345/680] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:29.239057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.251355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.252001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.252280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.252551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.253282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=d053a3f1d07641b586518ae0c0a39e4b) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:29.253588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.255002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.263159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 336/681] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/role_assignments?user.id=d053a3f1d07641b586518ae0c0a39e4b&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:29.263853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.342275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:29.367960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1401b82-b6ab-4ec2-aa88-c3a1ca6c15c6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.389354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1926ed-62ee-45ab-8c5d-0b15395a0221 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.408453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.409091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.409508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.409784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.425423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:29.430125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.430759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.431041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.431316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:29.431733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:29.433284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:29.434133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:29.434871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:29.434871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.434996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 346/682] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:29.435063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.441463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.451731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 337/683] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:29.460362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.519580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:29.585614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef86bb-49c0-4ea7-9adb-4d167f52d2c9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.595542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5ee9b-e185-418f-8cb6-d61704451f15 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.626324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:29.637798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.638431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.638551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.638710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.638983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.639735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:29.639988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.640088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.640564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.640970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.641399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.651678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 347/684] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:29.656800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.657262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.658643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:29.676076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:29.677246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:29.678388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:29.678388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:29.678388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:29.683275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 338/685] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:29.686185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.810837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f964-5e3d-46c0-bf06-e2b414150d20 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.838065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:29.855141 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.855806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.856081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.856353 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.867500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.868947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.881534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6c7f9-a01a-45af-ac18-6d3cf2ade6aa None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:29.888459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:29.889430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:29.890690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:29.890690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:29.890690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:29.890690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 348/686] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:29.900630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:29.955618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:29.956298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:29.956574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:29.956844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:29.957535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:29.957838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:29.959285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:29.975280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 339/687] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:29.981306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:30.031631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:30.097206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7da12-eeed-4b07-adf2-642f0d217637 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:30.134533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e6e3c-ba10-4647-a1c7-01a78fc92d1a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:30.156149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:30.156874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:30.157154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:30.157426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:30.158166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:30.158463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:30.160066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:30.180034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 349/688] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:30.185217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:30.188444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:30.190080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:30.190368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:30.190646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:30.205695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:30.207179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:30.228526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:30.229697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:30.230641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:30.231759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 340/689] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:30.238872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:30.239542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:30.351884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:30.354864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae01a5-5996-4ce9-9573-2086562f5fd0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:30.390263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:30.390874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:30.391156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:30.391446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbae00e-b09d-403d-9a91-0760e1ef9cd6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:30.391555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:30.392201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:30.392507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:30.393930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:30.412391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 341/690] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 28 08:30:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:30.418995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:30.461378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:30.462231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:30.462649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:30.463074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:30.474591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:30.476229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:30.489542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:30.490722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:30.492011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:30.494549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 350/691] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:30:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:30.500545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:30.570106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11f56-6fe8-42ed-9b78-0b93b26c05a6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:30.603938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:30.621493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbd724-eaaa-4f8d-8f2a-0a68bf8170c2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:30.625266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:30.626119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:30.626541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:30.626956 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:30.669965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:30.700362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:30.701210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:30.701331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:30.701505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:30.702233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:30.702533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:30.708116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:30.720364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:30.721977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:30.742979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 351/692] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:30:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:30.748433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:30.838035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 342/693] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:30:30.839587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:30.901124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:30.951943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769e703-99a9-4701-b7da-9601a45d0156 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:30.991492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cd453-ef6e-4e76-8784-a7e38c143f6f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:31.005860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:31.006807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.007307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.007835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.021850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:31.023680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:31.050253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:31.051279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:31.052192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:31.052192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:31.052192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:31.059180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 343/694] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:31.063654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:31.070012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:31.070899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.071468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.071956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.117262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:31.197530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3483e-de3c-475d-98e0-12fc0dbe819b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:31.227878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:31.233526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:31.236140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:31.239709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:31.240553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.240994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.241423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.247155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:31.247155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:31.247155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:31.266325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 344/695] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:31.272175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:31.434999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 352/696] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 28 08:30:31.439529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:31.457606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f73356-ddcb-4d45-8b9e-d96c092e13d1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:31.514481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:31.549618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:31.550315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.550606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.550885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.566990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:31.568483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:31.576852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2231-4220-47e3-aab2-90039843da2e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:31.593748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:31.594702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:31.595668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 345/697] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:31.600624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:31.613115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:31.613749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.614029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.614300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.625760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:31.627215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:31.643846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:31.645819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:31.646989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:31.646989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:31.646989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:31.646989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 353/698] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:31.658413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:31.661485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:31.796230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bf129-e303-4968-84aa-fb6288711932 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:31.799792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:31.832052 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033d7c7-5093-44db-a657-9af291a68a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:31.832772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033d7c7-5093-44db-a657-9af291a68a2a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.833122 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033d7c7-5093-44db-a657-9af291a68a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.833466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033d7c7-5093-44db-a657-9af291a68a2a None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.834183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033d7c7-5093-44db-a657-9af291a68a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:31.834554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033d7c7-5093-44db-a657-9af291a68a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:31.836024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033d7c7-5093-44db-a657-9af291a68a2a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:31.852756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 354/699] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:31.852756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede9e8-c08b-4597-ab1c-7c37cef6d51d None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.852756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede9e8-c08b-4597-ab1c-7c37cef6d51d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.852756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede9e8-c08b-4597-ab1c-7c37cef6d51d None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.852756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 355/700] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:31.852756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dc904-fa2a-411b-ba92-62f1ddce868e None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.852756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dc904-fa2a-411b-ba92-62f1ddce868e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.853308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dc904-fa2a-411b-ba92-62f1ddce868e None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.854473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 356/701] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:31.855344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dc904-fa2a-411b-ba92-62f1ddce868e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:31.872117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc7f6-9097-4085-aa3b-847c18a8d22a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:31.909378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01727-d2d5-41f4-b415-03276382ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:31.910020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01727-d2d5-41f4-b415-03276382ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.910271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01727-d2d5-41f4-b415-03276382ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.910540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01727-d2d5-41f4-b415-03276382ffe4 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.911199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01727-d2d5-41f4-b415-03276382ffe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:31.911530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01727-d2d5-41f4-b415-03276382ffe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:31.912944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01727-d2d5-41f4-b415-03276382ffe4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:31.926657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 346/702] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:31.928622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ca5f-ef0a-4b2e-90eb-e647ad658448 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:31.928911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ca5f-ef0a-4b2e-90eb-e647ad658448 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:31.929184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730ca5f-ef0a-4b2e-90eb-e647ad658448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:31.950104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0730ca5f-ef0a-4b2e-90eb-e647ad658448 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:31.951329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0730ca5f-ef0a-4b2e-90eb-e647ad658448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:31.973497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dc904-fa2a-411b-ba92-62f1ddce868e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.012057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.012695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.012959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.013233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.020099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.021553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.035456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 347/703] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:32.035456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdcf33-586d-457e-b109-f709c3d3fcc7 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.035456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdcf33-586d-457e-b109-f709c3d3fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.035456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdcf33-586d-457e-b109-f709c3d3fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:32.035819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:32.036695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 357/704] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:32.037644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.056225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-18bdcf33-586d-457e-b109-f709c3d3fcc7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:32.057977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-18bdcf33-586d-457e-b109-f709c3d3fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:32.059199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.091765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.133519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 348/705] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:32.134366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdcf33-586d-457e-b109-f709c3d3fcc7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.155526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a6dd0-0671-4f30-a232-522adb7b1ba2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.199330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17095b-aace-46ad-8f00-b5f9c2132b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.200032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17095b-aace-46ad-8f00-b5f9c2132b98 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.200448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17095b-aace-46ad-8f00-b5f9c2132b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.200863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17095b-aace-46ad-8f00-b5f9c2132b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.201593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17095b-aace-46ad-8f00-b5f9c2132b98 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=6717f091388748d8aad2eafcb50fd61a) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:32.201904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17095b-aace-46ad-8f00-b5f9c2132b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.203347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17095b-aace-46ad-8f00-b5f9c2132b98 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.211774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 358/706] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/role_assignments?user.id=6717f091388748d8aad2eafcb50fd61a&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:32.213084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b59d-810a-4bc1-9b4f-5a51d0e70a67 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.213374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b59d-810a-4bc1-9b4f-5a51d0e70a67 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.213738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b59d-810a-4bc1-9b4f-5a51d0e70a67 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.219707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 359/707] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:32.221634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1470ebe-62c2-48d7-b85d-ae7646a78203 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.221914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1470ebe-62c2-48d7-b85d-ae7646a78203 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.222186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1470ebe-62c2-48d7-b85d-ae7646a78203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.242357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b1470ebe-62c2-48d7-b85d-ae7646a78203 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:32.243595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b1470ebe-62c2-48d7-b85d-ae7646a78203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:32.253483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdcf33-586d-457e-b109-f709c3d3fcc7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.293432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.294429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.294955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.295452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.296529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:32.297037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.298658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.312990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 349/708] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:32.314156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.326447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.350355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 360/709] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:32.351648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1470ebe-62c2-48d7-b85d-ae7646a78203 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.378437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.478433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94631346-35c6-4743-8ae4-2af1a2f4f66a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.503454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1470ebe-62c2-48d7-b85d-ae7646a78203 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.520196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.520713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.521444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.521444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] PATH_INFO: `/v3/services/network` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.521965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.523305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:32.537125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:32.538185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:32.539065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 350/710] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:32.539906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.548343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.548343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.549307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.549307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.549853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=0969ec55ae1244c09694079a72bf8310) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:32.551539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.552354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.560693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 361/711] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/role_assignments?user.id=0969ec55ae1244c09694079a72bf8310&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:32.561666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.627687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.665703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395553-0346-4cdf-92e1-865c4fad7c7a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.677925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.717431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34215ff-4248-4c83-b5ae-b408ad11b54f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.727966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.729492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.730007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.730685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.746352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.748952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.758547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.759168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.759481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.759763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.761533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] RBAC: Adding query filter params (name=network) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:32.762243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.763805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.769037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 362/712] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:32.769981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:32.770393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:32.771317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:32.772605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:32.772605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:32.772605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:32.775746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 351/713] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:32.779283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.888188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58394-abcc-4ba1-af52-a8f0ac364d92 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.904133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f666-9d75-4f8f-b8e5-0c1d5b707e60 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:32.925980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.926626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.926909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.927234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.928390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.934727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.939611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.943056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:32.943695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:32.944031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:32.944308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:32.944941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] RBAC: Adding query filter params (type=network) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:32.945223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:32.946214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:32.947095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:32.949089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:32.949089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:32.949234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 363/714] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:32.949234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:32.964266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:32.967734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 352/715] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:32.968773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:33.079223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cd519-027c-482f-a7c2-a88844b80b44 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:33.137334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:33.137963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:33.138292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:33.138499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:33.139157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:33.139473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:33.140886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:33.170228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 364/716] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:33.176333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:33.203284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05952a-acad-4c40-af1c-f9abfb1b6269 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:33.241317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:33.241942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:33.242225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:33.242496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:33.243127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:33.243449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:33.245439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:33.250281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 353/717] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 28 08:30:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:33.255886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:33.265809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:33.317310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92453640-b9bb-4432-90b5-7389ab5663f0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:33.326369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:33.384352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d43d-db86-4091-9577-295c484a6c11 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:33.384578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344b9f-5f7f-4e4d-9a23-e5086ac1dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:33.385031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344b9f-5f7f-4e4d-9a23-e5086ac1dc90 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:33.385390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344b9f-5f7f-4e4d-9a23-e5086ac1dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:33.385720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344b9f-5f7f-4e4d-9a23-e5086ac1dc90 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:33.386719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344b9f-5f7f-4e4d-9a23-e5086ac1dc90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:33.388194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344b9f-5f7f-4e4d-9a23-e5086ac1dc90 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:33.424744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b789d3-f921-4575-804a-f10eb29181df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:33.425771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b789d3-f921-4575-804a-f10eb29181df None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:33.426248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b789d3-f921-4575-804a-f10eb29181df None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:33.426712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b789d3-f921-4575-804a-f10eb29181df None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:33.427569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b789d3-f921-4575-804a-f10eb29181df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:33.428120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b789d3-f921-4575-804a-f10eb29181df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:33.429820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b789d3-f921-4575-804a-f10eb29181df None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:33.435299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 354/718] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 28 08:30:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:33.519481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 365/719] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:30:33 2022] POST /identity/v3/users => generated 254 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:34.960402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700abc81-416d-48f3-a3df-22113e55354c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:34.961387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700abc81-416d-48f3-a3df-22113e55354c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:34.961863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700abc81-416d-48f3-a3df-22113e55354c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:34.964210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 355/720] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:34.969648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4bc2-165e-4f03-89c5-308e9740987c None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:34.970484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4bc2-165e-4f03-89c5-308e9740987c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:34.971026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4bc2-165e-4f03-89c5-308e9740987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:34.975240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e85007-6786-4f7d-b1f9-f9edd2d8ae18 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:34.976254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e85007-6786-4f7d-b1f9-f9edd2d8ae18 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:34.977269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e85007-6786-4f7d-b1f9-f9edd2d8ae18 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:34.980648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 356/721] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:34.988622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbe63-3894-4c98-91e9-8ce298081c74 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:34.989204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbe63-3894-4c98-91e9-8ce298081c74 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:34.989677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbe63-3894-4c98-91e9-8ce298081c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:34.998461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-494e4bc2-165e-4f03-89c5-308e9740987c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:34.998924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-494e4bc2-165e-4f03-89c5-308e9740987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:35.017698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a22dbe63-3894-4c98-91e9-8ce298081c74 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:35.019154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a22dbe63-3894-4c98-91e9-8ce298081c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:35.078264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 366/722] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:35.119825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 357/723] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:35.411752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4bc2-165e-4f03-89c5-308e9740987c None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:35.466064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbe63-3894-4c98-91e9-8ce298081c74 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:35.486459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:35.551658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:35.563754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4bc2-165e-4f03-89c5-308e9740987c None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:35.604468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:35.605114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:35.605399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:35.605666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:35.629603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:35.630061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbe63-3894-4c98-91e9-8ce298081c74 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:35.646914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:35.647948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:35.648800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 367/724] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:35.656185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:35.666375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:35.667002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:35.667283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:35.667584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:35.678190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:35.683726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:35.685656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:35.686687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 358/725] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:35.693204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:35.811001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c44e3-dad2-4f86-acef-2a78c3cc8af5 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:35.823583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:35.843965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5aad8-7acc-4f58-9655-ac3d9ecbae78 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:35.852158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:35.860106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a12c39-5f22-480d-843f-f967cecfff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:35.861085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a12c39-5f22-480d-843f-f967cecfff01 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:35.861367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a12c39-5f22-480d-843f-f967cecfff01 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:35.861915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a12c39-5f22-480d-843f-f967cecfff01 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:35.862590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a12c39-5f22-480d-843f-f967cecfff01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:35.863051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a12c39-5f22-480d-843f-f967cecfff01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:35.864750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a12c39-5f22-480d-843f-f967cecfff01 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:35.878036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 368/726] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:35.879264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d522f-8f4e-40b6-b57d-0d43513cea6f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:35.879574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d522f-8f4e-40b6-b57d-0d43513cea6f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:35.882444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d522f-8f4e-40b6-b57d-0d43513cea6f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:35.882604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:35.882604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:35.882604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:35.883031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:35.883790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:35.884162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:35.885903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 369/727] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:35.886531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:35.887309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad08f-4d95-4e9b-819b-db2e13120ab1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:35.887636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad08f-4d95-4e9b-819b-db2e13120ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:35.887915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad08f-4d95-4e9b-819b-db2e13120ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:35.896054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 359/728] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:35.897043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:35.912197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e22ad08f-4d95-4e9b-819b-db2e13120ab1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:35.917184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e22ad08f-4d95-4e9b-819b-db2e13120ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:36.021455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 370/729] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:36.021455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad08f-4d95-4e9b-819b-db2e13120ab1 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.039077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1ac1f-ae2e-4276-acc7-f69a182accd1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:36.094356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4382-3cfc-43c4-befe-e02d6040368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:36.095044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4382-3cfc-43c4-befe-e02d6040368a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.095367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4382-3cfc-43c4-befe-e02d6040368a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.095667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4382-3cfc-43c4-befe-e02d6040368a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.108986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4382-3cfc-43c4-befe-e02d6040368a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:36.110566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4382-3cfc-43c4-befe-e02d6040368a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-560f4382-3cfc-43c4-befe-e02d6040368a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:36.125514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:36.126489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:36.127402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:36.127402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:36.127402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:36.128506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 360/730] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:36.132675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aa508-c36d-408c-b397-63b080b2c984 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.132956 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aa508-c36d-408c-b397-63b080b2c984 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.133228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aa508-c36d-408c-b397-63b080b2c984 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.134641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 361/731] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:36.136857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aa508-c36d-408c-b397-63b080b2c984 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.166467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:36.204847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad08f-4d95-4e9b-819b-db2e13120ab1 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:36.206431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:36.241762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4bc7-b6ea-4139-8b40-e53dfef85420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:36.242718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4bc7-b6ea-4139-8b40-e53dfef85420 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.243233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4bc7-b6ea-4139-8b40-e53dfef85420 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.243845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4bc7-b6ea-4139-8b40-e53dfef85420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.255345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4bc7-b6ea-4139-8b40-e53dfef85420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:36.257177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4bc7-b6ea-4139-8b40-e53dfef85420 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:36.270465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aa508-c36d-408c-b397-63b080b2c984 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-869f4bc7-b6ea-4139-8b40-e53dfef85420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:36.274548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:36.275562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:36.277118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:36.277118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:36.277118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:36.279255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 371/732] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:36.280737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968daa5-8386-4a39-a1f4-1ca54e29749b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.281214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968daa5-8386-4a39-a1f4-1ca54e29749b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.281699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968daa5-8386-4a39-a1f4-1ca54e29749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.305351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0968daa5-8386-4a39-a1f4-1ca54e29749b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:36.306941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0968daa5-8386-4a39-a1f4-1ca54e29749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:36.315923 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:36.316638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.316915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.317187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.317885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:36.318188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:36.319712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:36.339529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 362/733] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:36.340460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.432835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:36.453449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38543eb-adab-4358-ba02-505a34c5cdee None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:36.502733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:36.503286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.503598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.503945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.504667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:36.504982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:36.506708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:36.515566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 372/734] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:36.515566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968daa5-8386-4a39-a1f4-1ca54e29749b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.530758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 363/735] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:36.532087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.621013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:36.639629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968daa5-8386-4a39-a1f4-1ca54e29749b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:36.641785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42c0a9-323a-4c94-8c1f-77925dd28c85 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:36.676317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f62b5e-ef6b-4c79-99ac-d9736e9f1995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:36.676915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62b5e-ef6b-4c79-99ac-d9736e9f1995 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.677190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62b5e-ef6b-4c79-99ac-d9736e9f1995 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.677332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:36.677511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62b5e-ef6b-4c79-99ac-d9736e9f1995 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.677925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.678085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f62b5e-ef6b-4c79-99ac-d9736e9f1995 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:36.678238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.678472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.679445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f62b5e-ef6b-4c79-99ac-d9736e9f1995 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:36.686388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:36.687833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:36.690321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:36.699407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:36.700557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:36.701636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 364/736] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:30:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:36.703327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.783773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 373/737] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:30:36 2022] POST /identity/v3/services => generated 240 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:36.785079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a4b5-a0ae-4054-9e75-f6b1e4f38276 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.788232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a4b5-a0ae-4054-9e75-f6b1e4f38276 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.788232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a4b5-a0ae-4054-9e75-f6b1e4f38276 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.788232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 374/738] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:36.788232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a4b5-a0ae-4054-9e75-f6b1e4f38276 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.834291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8da2a-890b-4213-ad63-18fae4235b38 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:36.919547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:36.919547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:36.919547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:36.919547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:36.930530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:36.934061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:36.947569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:36.949429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:36.950564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 365/739] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:36.951359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:36.983632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a4b5-a0ae-4054-9e75-f6b1e4f38276 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.034836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:37.038985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1957f9-373c-475e-9d8e-06210c44350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.039829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1957f9-373c-475e-9d8e-06210c44350f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.045673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1957f9-373c-475e-9d8e-06210c44350f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.045673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1957f9-373c-475e-9d8e-06210c44350f None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.045673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1957f9-373c-475e-9d8e-06210c44350f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:37.045673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1957f9-373c-475e-9d8e-06210c44350f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:37.045673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1957f9-373c-475e-9d8e-06210c44350f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:37.067326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 375/740] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:30:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:37.069593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f2e1-7e9c-416d-9f38-9d9aa0dd9754 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.070025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f2e1-7e9c-416d-9f38-9d9aa0dd9754 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.070442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68f2e1-7e9c-416d-9f38-9d9aa0dd9754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.078104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:37.090047 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b74962-5381-4044-b07f-b57827c0d4c0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.094685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ea68f2e1-7e9c-416d-9f38-9d9aa0dd9754 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:37.094685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ea68f2e1-7e9c-416d-9f38-9d9aa0dd9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:37.138313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.138930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.139211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.139570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.140234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:37.141591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:37.191453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 376/741] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:37 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 28 08:30:37.191453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68f2e1-7e9c-416d-9f38-9d9aa0dd9754 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:37.254918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 366/742] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:30:36 2022] POST /identity/v3/services => generated 251 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:37.255975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:37.343524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68f2e1-7e9c-416d-9f38-9d9aa0dd9754 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.376490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:37.394330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.398821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.398821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.398821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.398821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:37.398821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:37.398821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:37.419144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 377/743] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:37.424712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:37.474841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18815-8acf-4c33-83b5-dbbbb1446950 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.492843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:37.513597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.514235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.514517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.514778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.528434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:37.529901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:37.548815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:37.549825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:37.550733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:37.550733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:37.550733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:37.550733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 367/744] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:37.551472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:37.558332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf0c44-fd2e-47ef-9a98-a4d054218a2f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.594586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.595547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.596028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.596497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.655701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:37.657738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00e98a-fe76-48ff-aaac-1310c019a2e2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.671582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:37.673341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:37.695789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.696378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.696727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.697002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.709891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:37.715279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:37.720717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 368/745] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:37.721581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:37.775868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:37.794140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 378/746] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:30:37.795359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:37.846355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22776ed-ec0c-406d-aba8-b426e6da7bb2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.888241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.889202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.889666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.890118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.891046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:37.891581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:37.893137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:37.895104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:37.906309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 369/747] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:37.908204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:37.914902 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5515095-7563-469e-8b9f-e3c6d9cff49c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:37.958350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:37.959302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:37.959834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:37.960301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:37.961175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:37.961673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:37.963969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:37.972714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 379/748] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:37.973760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.033002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:38.050050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370251-1805-41e8-af65-843a32f11a6d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.093195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c38481-18fe-4baf-98f3-2b26956ea536 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.098292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.098878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.099162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.099459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.113765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.115538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:38.133113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:38.134297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:38.136940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:38.136940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:38.136940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:38.137119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.137119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.137119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.137119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.142022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 370/749] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:38.142964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.143585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.145039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:38.159972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:38.160911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:38.161903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:38.164565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 380/750] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:38.165659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.179502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:38.274993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8d5da-ce2a-4379-b96a-c9119b2fc63e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.304321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af106fc2-e707-420e-b8b0-43d1fe6344a7 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.315994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.316799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.317218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.317698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.327674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:38.330120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.331890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:38.346996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:38.348170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:38.349115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:38.349115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:38.349115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:38.349308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.349404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.349842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.349937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.350570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:38.350858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.352077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 371/751] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:38.352247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.353244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.370776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 381/752] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:38.372018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.442727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:38.478718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519493fa-0d84-4402-a568-933a88bfae8e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.498524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624446a4-5896-4119-975e-dabbd81ebe20 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.518913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.519926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.520402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.520866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.521789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:38.522297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.523912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.537172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 382/753] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:38.538409 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.548916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.549798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.550321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.550784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.551717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:38.552299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.553900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.571546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 372/754] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:38.573362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.632453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:38.664789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a2705-8de6-48ad-b922-9435a6f364ca None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.694921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:38.700748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c4a21-ce07-4117-b2e2-1445b7b47d1f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.704464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.705021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.705395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.705761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.713404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.715056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:38.727198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:38.728369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:38.729689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:38.731450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 383/755] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:38.732562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.746708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.747608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.748422 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.748846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.759240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.761853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:38.777760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:38.778944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:38.780172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:38.787658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 373/756] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:38.787658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.851275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9dd2f-f568-4d3e-be66-06e52688668f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.895013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.896293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.896777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.897423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/0969ec55ae1244c09694079a72bf8310/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.899975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=0969ec55ae1244c09694079a72bf8310, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.902805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.917584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c365a-7398-42ed-a9e9-7e13e45be478 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:38.931715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:38.952517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:38.953213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:38.953494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:38.953805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:38.954478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:38.954780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:38.956211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:38.968552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 374/757] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:38.975557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:38.984891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 384/758] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:38 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/0969ec55ae1244c09694079a72bf8310/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:38.985630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:39.112564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:39.164153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f91672-b2b5-4417-8619-1259047e7600 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:39.202964 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a86a-6701-4fc7-a752-2ae9d0932cb0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:39.215014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c6faa-4842-451c-a622-bd193c2c0eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:39.215663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c6faa-4842-451c-a622-bd193c2c0eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.215944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c6faa-4842-451c-a622-bd193c2c0eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.216213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c6faa-4842-451c-a622-bd193c2c0eb5 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.216947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c6faa-4842-451c-a622-bd193c2c0eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:39.217247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c6faa-4842-451c-a622-bd193c2c0eb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:39.218687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c6faa-4842-451c-a622-bd193c2c0eb5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:39.238743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 375/759] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:39.240042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc24ab-928d-4183-a677-bb6968da971e None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.240329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc24ab-928d-4183-a677-bb6968da971e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.240601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc24ab-928d-4183-a677-bb6968da971e None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.241966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 376/760] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:39.245820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc24ab-928d-4183-a677-bb6968da971e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:39.262335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a9f8a-f685-4f64-8293-8e34631ce9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:39.263054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9f8a-f685-4f64-8293-8e34631ce9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.263338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9f8a-f685-4f64-8293-8e34631ce9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.263645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a9f8a-f685-4f64-8293-8e34631ce9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.264430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9f8a-f685-4f64-8293-8e34631ce9f4 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=6717f091388748d8aad2eafcb50fd61a) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:39.264745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9f8a-f685-4f64-8293-8e34631ce9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:39.266368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a9f8a-f685-4f64-8293-8e34631ce9f4 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:39.272669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 385/761] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:38 2022] GET /identity/v3/role_assignments?user.id=6717f091388748d8aad2eafcb50fd61a&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:39.273846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21061de1-be63-4bab-ab91-70f5a2c7d38a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.274183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21061de1-be63-4bab-ab91-70f5a2c7d38a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.274468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21061de1-be63-4bab-ab91-70f5a2c7d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.283657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:39.295897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-21061de1-be63-4bab-ab91-70f5a2c7d38a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:39.299891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-21061de1-be63-4bab-ab91-70f5a2c7d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:39.380375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc24ab-928d-4183-a677-bb6968da971e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:39.421950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40909b3-4f4b-4a1d-9c26-881b840a4495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:39.422506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40909b3-4f4b-4a1d-9c26-881b840a4495 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.422793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40909b3-4f4b-4a1d-9c26-881b840a4495 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.423128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40909b3-4f4b-4a1d-9c26-881b840a4495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.449034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 386/762] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:39.512621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40909b3-4f4b-4a1d-9c26-881b840a4495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:39.514164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40909b3-4f4b-4a1d-9c26-881b840a4495 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:39.555097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:39.634826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 377/763] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:30:39.641173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21061de1-be63-4bab-ab91-70f5a2c7d38a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:39.645224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312b2e0-56fd-412a-9496-887bf8de6b9a None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.645516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312b2e0-56fd-412a-9496-887bf8de6b9a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.645803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312b2e0-56fd-412a-9496-887bf8de6b9a None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.647372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 378/764] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:39.659218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ebf0-6509-44bf-a5bb-fa50df405501 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.659553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ebf0-6509-44bf-a5bb-fa50df405501 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.659813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5ebf0-6509-44bf-a5bb-fa50df405501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.691724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-88d5ebf0-6509-44bf-a5bb-fa50df405501 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:39.692855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-88d5ebf0-6509-44bf-a5bb-fa50df405501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:39.693407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:39.781936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21061de1-be63-4bab-ab91-70f5a2c7d38a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:39.803458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 379/765] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:30:39.803458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5ebf0-6509-44bf-a5bb-fa50df405501 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:39.846607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:39.847513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:39.847986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:39.849088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:39.871537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:39.873334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:39.899981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:39.901363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:39.902253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:39.902253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:39.902253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:39.904337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 387/766] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:39.909831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:39.914205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:39.993222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5ebf0-6509-44bf-a5bb-fa50df405501 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.061498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.062144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.062520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.062695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] PATH_INFO: `/v3/services/network` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.063281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.064737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.073232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad663f-eff7-47cd-b1cf-f00ff280fdd5 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.082731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:40.083379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:40.084367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:40.085197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:40.091937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 380/767] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:39 2022] GET /identity/v3/services/network => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:40.097746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.114450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.115762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.116287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.116854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.117773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:40.118441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.120655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.134522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 388/768] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:40.136387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.236339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f29ed-0abe-41b5-99d9-5c87e91eb50d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.245125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a31533-cbb9-4803-b173-edec3dd79a36 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.262706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:40.273865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.275054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.275054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.275350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.277350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] RBAC: Adding query filter params (name=network) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:40.277730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.279260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.284497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 381/769] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:40.284954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.285539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.286013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.286473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.286912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.287734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.289396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:40.299484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:40.300525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:40.301406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:40.304095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 389/770] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:40.305063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.325996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:40.407927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a95c86-3a9f-4d92-b3c5-a0c351e2d828 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.415926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4528d-3e0f-49a2-97a5-246657916d2a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.445171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.445803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.446146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.446363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.454304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.454873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.455471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.455960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.456360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.456665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.457481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:40.458080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.459774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.466640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 390/771] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:40.467806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:40.469035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:40.469929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:40.471524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 382/772] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:40.476365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.534266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:40.565302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:40.585325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3aa8-1ae6-4925-a781-031f94ef63d9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.592772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0a20a-549f-42b7-90c9-418d65783955 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.623808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.624485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.624688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.625021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.625586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:40.625885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.627539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.637457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.637653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 391/773] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:40.637653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.638687 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.639122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.639589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.640453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] RBAC: Adding query filter params (interface=public, service_id=d8ebf90e5f8b4f76be7d5dd7fc6c4b7b, region_id=RegionOne) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:40.640919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.642437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.652314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 383/774] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/endpoints?service_id=d8ebf90e5f8b4f76be7d5dd7fc6c4b7b&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:40.653329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.753660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2713d32-b80d-4c6f-b7f6-fb1b11b61a6d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.770177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8a8d-3081-4d2a-b75b-999b9c77d057 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.785202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:40.791206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.792601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.792876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.793237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.794063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:40.794428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.796035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.811549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 392/775] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:40.811549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.817334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.818114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.818500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.818880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.819662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:40.820073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.821618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:40.823687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:40.839737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 384/776] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:40.841084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:40.942249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d86023-1d7a-49ab-a2e2-dbdd620bd001 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.973592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462410a-9f1c-4fcf-858f-8d4a94dfb0ec None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:40.991452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:40.992330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:40.993064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:40.993416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:40.994104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:40.996718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:41.011452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 393/777] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:41.011452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:41.027454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:41.028095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:41.031132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:41.031536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:41.032335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=a5f192aca43c40508a5f8fb9611bf5cc) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:41.032653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:41.034128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:41.052642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 385/778] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:40 2022] GET /identity/v3/role_assignments?user.id=a5f192aca43c40508a5f8fb9611bf5cc&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:41.136967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:41.176605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370a8b-46eb-4749-8790-44ca656e9a8b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:41.219757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f473b31-d4c6-42a8-aa2a-a619777992b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:41.220384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473b31-d4c6-42a8-aa2a-a619777992b3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:41.220665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473b31-d4c6-42a8-aa2a-a619777992b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:41.220940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473b31-d4c6-42a8-aa2a-a619777992b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:41.221657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473b31-d4c6-42a8-aa2a-a619777992b3 None admin] RBAC: Adding query filter params (interface=public, service_id=8cbda4c211f042f28c7cd2262b6f2c0d, region_id=RegionOne) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:41.221966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473b31-d4c6-42a8-aa2a-a619777992b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:41.223359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473b31-d4c6-42a8-aa2a-a619777992b3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:41.233594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 394/779] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:30:41 2022] GET /identity/v3/endpoints?service_id=8cbda4c211f042f28c7cd2262b6f2c0d&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:41.244686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:41.309844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:41.370628 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba6a14-6d04-4a86-8eec-f8ef31bef754 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:41.413430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0fb0c-b8da-494e-876d-f89951604fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:41.414120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fb0c-b8da-494e-876d-f89951604fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:41.414400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fb0c-b8da-494e-876d-f89951604fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:41.414672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0fb0c-b8da-494e-876d-f89951604fa5 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:41.415353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0fb0c-b8da-494e-876d-f89951604fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:41.417314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0fb0c-b8da-494e-876d-f89951604fa5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:41.423112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 386/780] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:30:41 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:41.557553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198c9b-3b86-43ed-a654-ca2b1f05f842 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:41.557992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198c9b-3b86-43ed-a654-ca2b1f05f842 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:41.558206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d198c9b-3b86-43ed-a654-ca2b1f05f842 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:41.559803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 395/781] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:41.565342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98ed0-49a0-42fd-a8c4-6ca6018687b0 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:41.565566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98ed0-49a0-42fd-a8c4-6ca6018687b0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:41.565835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f98ed0-49a0-42fd-a8c4-6ca6018687b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:41.593883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d5f98ed0-49a0-42fd-a8c4-6ca6018687b0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:41.595073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d5f98ed0-49a0-42fd-a8c4-6ca6018687b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:41.679000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 387/782] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:41.909234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a32d5f-cc14-4034-9fe5-07eccddf6327 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:41.909539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a32d5f-cc14-4034-9fe5-07eccddf6327 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:41.909737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a32d5f-cc14-4034-9fe5-07eccddf6327 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:41.911289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 396/783] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:41.916842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3c89-5cbf-48cf-918c-b52147968d6a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:41.917131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3c89-5cbf-48cf-918c-b52147968d6a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:41.917400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3c89-5cbf-48cf-918c-b52147968d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:41.945470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-555e3c89-5cbf-48cf-918c-b52147968d6a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:41.946652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-555e3c89-5cbf-48cf-918c-b52147968d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:41.974944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:42.017972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 388/784] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:42.039931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a32d5f-cc14-4034-9fe5-07eccddf6327 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:42.200126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a32d5f-cc14-4034-9fe5-07eccddf6327 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:42.271451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:42.271451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:42.271451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:42.271451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:42.272965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:42.285560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:42.290362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:42.292004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:42.292881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:42.299382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 397/785] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:42.304652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3c89-5cbf-48cf-918c-b52147968d6a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:42.350955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:42.525038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3c89-5cbf-48cf-918c-b52147968d6a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:42.567132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:42.568293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:42.569523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:42.570601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:42.571677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:42.573456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:42.575218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:42.589618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2daedb-a656-4966-8da2-9239c96cabab None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:42.601230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 389/786] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:42.602489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:42.654739 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:42.690852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:42.691879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:42.692363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:42.692832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:42.720637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:42.726837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:42.727794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:42.728737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 398/787] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:42.735085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:42.822654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5f7e-01d6-4340-bc36-11832d434092 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:42.891800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:42.910959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:42.911569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:42.911857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:42.912142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:42.940646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:42.944040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:42.972516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:42.973502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:42.974394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:42.974394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:42.974394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:42.987478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 390/788] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:42.990067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:42.990178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32abc4-b785-448f-b13a-06ec02f2ed1c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:43.079486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:43.080115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.080396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.080671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.081348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:43.084275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:43.084275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:43.110341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 399/789] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:43.116239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:43.187709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:43.239775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf76b-d6d2-4085-96d7-d9efffa0dd99 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:43.324135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:43.324765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.325013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.327441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.327441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:43.327441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:43.327759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:43.344401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163d7b-1144-482f-af40-65ba1f1fc1fb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:43.359600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 391/790] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:43.366502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:43.389197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:43.423779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:43.424433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.424762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.426490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.453046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:43.454519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:43.491198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:43.492234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:43.493137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:43.493137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:43.493137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:43.493137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 400/791] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:43.503041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:43.598348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c4a7e-5c9b-45e2-a2a9-4a38ba359da9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:43.690703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fe75a-d938-481c-b533-bfe499164b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:43.691347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fe75a-d938-481c-b533-bfe499164b71 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.691657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fe75a-d938-481c-b533-bfe499164b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.691930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fe75a-d938-481c-b533-bfe499164b71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.708015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fe75a-d938-481c-b533-bfe499164b71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:43.710539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fe75a-d938-481c-b533-bfe499164b71 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:43.718099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:43.736689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f63ab8-6543-4939-88c6-75e42f448b16 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-415fe75a-d938-481c-b533-bfe499164b71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:43.740527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:43.741472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:43.742447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 392/792] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:30:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:43.743044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fc7c3-8a67-4142-8e1c-5c5249790bf3 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.745303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fc7c3-8a67-4142-8e1c-5c5249790bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.745303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fc7c3-8a67-4142-8e1c-5c5249790bf3 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.750815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 393/793] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:43.750815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fc7c3-8a67-4142-8e1c-5c5249790bf3 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:43.781554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15272a-d030-4aa4-9076-8844a5b5ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:43.782415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15272a-d030-4aa4-9076-8844a5b5ec64 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.782574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15272a-d030-4aa4-9076-8844a5b5ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.783192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15272a-d030-4aa4-9076-8844a5b5ec64 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.784146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15272a-d030-4aa4-9076-8844a5b5ec64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:43.784146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15272a-d030-4aa4-9076-8844a5b5ec64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:43.785420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15272a-d030-4aa4-9076-8844a5b5ec64 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:43.798979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 401/794] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:43.800399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd629fb6-7328-44e9-9548-013fe6de9e08 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.800687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd629fb6-7328-44e9-9548-013fe6de9e08 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.800959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd629fb6-7328-44e9-9548-013fe6de9e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.821752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-cd629fb6-7328-44e9-9548-013fe6de9e08 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:43.822942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cd629fb6-7328-44e9-9548-013fe6de9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:43.850213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:43.865717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fc7c3-8a67-4142-8e1c-5c5249790bf3 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:43.904538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 402/795] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:43.904538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dee8c-608e-4bf3-bbba-fb9f7d78840b None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.904538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dee8c-608e-4bf3-bbba-fb9f7d78840b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.904538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dee8c-608e-4bf3-bbba-fb9f7d78840b None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.904538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 403/796] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:43.904538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dee8c-608e-4bf3-bbba-fb9f7d78840b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:43.913907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b1dc-92b6-470b-87c7-ef20c8b0af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:43.913907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b1dc-92b6-470b-87c7-ef20c8b0af5b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.913907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b1dc-92b6-470b-87c7-ef20c8b0af5b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.913907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b1dc-92b6-470b-87c7-ef20c8b0af5b None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.914274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b1dc-92b6-470b-87c7-ef20c8b0af5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:43.914274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b1dc-92b6-470b-87c7-ef20c8b0af5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:43.917688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b1dc-92b6-470b-87c7-ef20c8b0af5b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:43.942523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 394/797] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:30:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:43.943827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe531b-189e-47be-a172-4ef6475848a4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:43.944190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe531b-189e-47be-a172-4ef6475848a4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:43.944539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe531b-189e-47be-a172-4ef6475848a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:43.963877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c7fe531b-189e-47be-a172-4ef6475848a4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:43.965164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c7fe531b-189e-47be-a172-4ef6475848a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:44.023854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.043074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 395/798] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:44.044247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe531b-189e-47be-a172-4ef6475848a4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.047470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dee8c-608e-4bf3-bbba-fb9f7d78840b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.095446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.095446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.095868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.096161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.104532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.105991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:44.118101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:44.119047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:44.120990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 404/799] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:44.126322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.148313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.242245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e677a-b66b-451b-a3ef-7d3f0f544a00 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.257672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe531b-189e-47be-a172-4ef6475848a4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.278607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.279215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.279526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.279803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.280537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:44.280843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.282391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.299705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.300414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.300611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.300871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.303480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 405/800] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:44.304299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.364610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.377099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.378521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.380114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.404036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed879ad-7ae9-4308-b11d-d2079271e313 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.437572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114858-5ea5-4f55-9c62-2d0b7ec90dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.438194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114858-5ea5-4f55-9c62-2d0b7ec90dac None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.438470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114858-5ea5-4f55-9c62-2d0b7ec90dac None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.438743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114858-5ea5-4f55-9c62-2d0b7ec90dac None admin] PATH_INFO: `/v3/services/network` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.439326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114858-5ea5-4f55-9c62-2d0b7ec90dac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.440729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114858-5ea5-4f55-9c62-2d0b7ec90dac None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-24114858-5ea5-4f55-9c62-2d0b7ec90dac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:44.449966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:44.456325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:44.457354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 406/801] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/services/network => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:44.458385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbe44-13d9-47ca-b4c4-6812cd7a3a48 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.458385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbe44-13d9-47ca-b4c4-6812cd7a3a48 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.458385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fbe44-13d9-47ca-b4c4-6812cd7a3a48 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.458385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 407/802] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:44.458385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fbe44-13d9-47ca-b4c4-6812cd7a3a48 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.485193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 396/803] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:30:44.486036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.559132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fbe44-13d9-47ca-b4c4-6812cd7a3a48 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.569411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.584387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720236-bb82-4fbd-adf4-65adceaa154a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.593424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.594040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.594316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.594583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.602829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.605599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.607216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.618165 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a89e5-a910-464f-a8e1-4a57d07d2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.618742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a89e5-a910-464f-a8e1-4a57d07d2dbd None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.619028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a89e5-a910-464f-a8e1-4a57d07d2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.619934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a89e5-a910-464f-a8e1-4a57d07d2dbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:44.622368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:44.629159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:44.630096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:44.630096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:44.630096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:44.630096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 408/804] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:44.630096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.630694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a89e5-a910-464f-a8e1-4a57d07d2dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-9e7a89e5-a910-464f-a8e1-4a57d07d2dbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:44.636548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:44.642498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 397/805] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:44.643932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d772f-510c-4fac-972c-3b9f7961d776 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.645136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d772f-510c-4fac-972c-3b9f7961d776 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.645136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d772f-510c-4fac-972c-3b9f7961d776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.657621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-021d772f-510c-4fac-972c-3b9f7961d776 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:44.658815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-021d772f-510c-4fac-972c-3b9f7961d776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:44.724532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81c7cd-65af-409b-a6b2-20743331194b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.724727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 398/806] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:44.725586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d772f-510c-4fac-972c-3b9f7961d776 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.767154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.767795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.768082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.768366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.769005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:44.769337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.770681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.779569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 409/807] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:44.779569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.823935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.838696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:44.847243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d772f-510c-4fac-972c-3b9f7961d776 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.883689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d90c64-756d-41cb-8c0f-09a7423aeac4 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:44.886928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.888155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.888441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.888718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.899412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.901405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:44.922659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:44.924163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:44.925071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:44.925071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:44.925071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:44.925071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 399/808] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:44.925071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:44.933093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:44.934069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:44.934549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:44.935042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:44.935920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:44.936424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:44.938007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:44.951306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 410/809] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:44.952242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.040955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf4c82-3c87-4272-a60a-93c9061cfbf4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.054756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2519898-5e6d-49b8-97bb-ce4aca847ae6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.068993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.072205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.076646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.077253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.077534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.077807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.078495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:45.078800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.080183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.088984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 400/810] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:45.089590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.094275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.094881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.095162 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.095455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.096088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] RBAC: Adding query filter params (type=network) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:45.096390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.097755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.102536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 411/811] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:30:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:45.103463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.194160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e6952-965f-42fd-adde-4988ece8cdf3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.209285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01138-94ac-426e-83e2-779b017ce464 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.228265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.229430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.229705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.229999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.230645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:45.230943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.232319 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.243330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 401/812] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:45.244052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.248196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.248851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.250883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.250883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.256941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.258408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:45.270442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:45.271589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 412/813] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:45.272516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.302193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.314861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.351372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c4d14-fe23-407a-99b5-f61df54b3b09 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.372397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46d152-6a7e-4cf1-93d7-897658c5a91c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.386261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.386975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.387319 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.387675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.388262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.389601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:45.398249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:45.399434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:45.400322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 402/814] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:45.401758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.409934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.410959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.411238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.411543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.422511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.423976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:45.438229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:45.439374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:45.440680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:45.440680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:45.440680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:45.443555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 413/815] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:45.444584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.502597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138c689-cf72-495f-8a78-183099119c61 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.517586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.536934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.537133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.537731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.538021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.538277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.538939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.540339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.545306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2d984-5c61-41f8-83a8-70c0ed51b61a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.578996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.579700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.579996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.580246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.586934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.588738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:45.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:45.600789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 414/816] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:45.602045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.623034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 403/817] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:30:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:45.623970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.728895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e92b24-3af0-4499-936b-ae94074715bf None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.749462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451d6a-9862-4b52-baa7-074f1fc444d4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.771019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.771669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.771953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.772248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.772950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:45.773258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.774735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.795547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 415/818] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:45.795547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.801513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.802138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.802413 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.803360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.803360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:45.803651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.804993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.814613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 404/819] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:45.814613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.814861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.849808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:45.908849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9ff6-5811-4cba-9dd2-f3a7068ea1f3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.928275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdce08-40dc-4efb-808c-17c521eb38a1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:45.945540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.946136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.946414 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.946680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.947338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:45.947902 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.949047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.959932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 416/820] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:45.960762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:45.964480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:45.965207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:45.965485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:45.965755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:45.966452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:45.966759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:45.968201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:45.980536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 405/821] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:45.981176 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:46.032268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:46.063538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cbc99-1805-41de-848f-c0630a9fc14e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:46.072443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:46.083204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c9f07-008f-4a4d-99f2-580550d98d06 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:46.103132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:46.104382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:46.104664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:46.104938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/6717f091388748d8aad2eafcb50fd61a/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:46.107065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=6717f091388748d8aad2eafcb50fd61a, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:46.111430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:46.123670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:46.127969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:46.127969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:46.127969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:46.127969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:46.127969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:46.127969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:46.132400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 406/822] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 28 08:30:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:46.132997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:46.183506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 417/823] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:45 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/6717f091388748d8aad2eafcb50fd61a/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:46.184455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:46.272666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a604ff-ffe7-4bb1-b406-40144dc19c43 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:46.316882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:46.317847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:46.318266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d38d82-21f9-41a3-85e8-457dd1dfce64 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:46.318502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:46.318979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:46.328293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:46.330110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:46.345940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:46.346973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:46.347982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:46.350737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 407/824] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:30:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:46.351782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:46.367821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:46.375451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:46.377088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:46.377088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:46.377088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:46.383209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=0969ec55ae1244c09694079a72bf8310) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:46.383209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:46.383209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:46.383443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:46.391234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 418/825] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:46 2022] GET /identity/v3/role_assignments?user.id=0969ec55ae1244c09694079a72bf8310&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:46.395508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:46.533062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76495b97-45f3-4ba6-b56a-f7ee12635062 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:46.583036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:46.584138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:46.584700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:46.584991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:46.585686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:46.586741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d722ea5-2caa-4281-9c6e-466e5f5cc473 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:46.587181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:46.628958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:46.629723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:46.629959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:46.630215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:46.630954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:46.631258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:46.632737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:46.651340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 419/826] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 28 08:30:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:46.656725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:46.684992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 408/827] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:30:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:46.748647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:46.792823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a395bd4-4868-4246-86f6-1e7a6f0dff7b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:46.847369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:46.848304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:46.848758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:46.849229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:46.860984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:46.862690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:46.879224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:46.880492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:46.881660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:46.881660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:46.881660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:46.883403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 420/828] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:46.890152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:46.969363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:47.006158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fa51a-9bf1-4b85-82cb-5ff07ac48f8c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:47.042374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:47.042960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:47.043188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:47.043485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:47.044138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:47.044443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:47.046247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:47.058814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 409/829] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:47.063961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:47.179256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452958aa-ebd3-46f9-919e-eb4908041d6a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:47.180886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:47.217529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:47.219181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:47.219296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:47.221656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:47.231447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:47.231447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:47.243448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:47.244768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:47.245829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 421/830] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:47.252512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:47.367519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb822ce-c976-451a-9a8a-79c96c721961 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:47.394310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:47.401584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397fca1-10c7-4246-9e5e-62af7e8ef05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:47.404072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397fca1-10c7-4246-9e5e-62af7e8ef05f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:47.404072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397fca1-10c7-4246-9e5e-62af7e8ef05f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:47.404072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397fca1-10c7-4246-9e5e-62af7e8ef05f None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:47.404072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397fca1-10c7-4246-9e5e-62af7e8ef05f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:47.404072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397fca1-10c7-4246-9e5e-62af7e8ef05f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:47.406357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397fca1-10c7-4246-9e5e-62af7e8ef05f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:47.418185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 410/831] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:47.423968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:47.556587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe6ea-f99f-4b8c-818a-ab6acdd2689b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:47.604025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ed28-b31f-4578-a0d9-e66117acf140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:47.607446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ed28-b31f-4578-a0d9-e66117acf140 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:47.607446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ed28-b31f-4578-a0d9-e66117acf140 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:47.607446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ed28-b31f-4578-a0d9-e66117acf140 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/a5f192aca43c40508a5f8fb9611bf5cc/roles/6288c02347fc4743b28fbb9e17d55542` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:47.627521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ed28-b31f-4578-a0d9-e66117acf140 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=a5f192aca43c40508a5f8fb9611bf5cc, role_id=6288c02347fc4743b28fbb9e17d55542)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:47.627521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ed28-b31f-4578-a0d9-e66117acf140 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:47.703736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 422/832] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:30:47 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/a5f192aca43c40508a5f8fb9611bf5cc/roles/6288c02347fc4743b28fbb9e17d55542 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:30:48.623447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef03f3-179a-43b3-85aa-4e28efaf7305 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:48.623447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef03f3-179a-43b3-85aa-4e28efaf7305 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:48.623447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef03f3-179a-43b3-85aa-4e28efaf7305 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:48.623447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 411/833] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:48.629144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fffba-22d7-4aa6-ac00-7cfc1ceeb9d9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:48.629530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fffba-22d7-4aa6-ac00-7cfc1ceeb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:48.629720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fffba-22d7-4aa6-ac00-7cfc1ceeb9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:48.663514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-153fffba-22d7-4aa6-ac00-7cfc1ceeb9d9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:48.663514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-153fffba-22d7-4aa6-ac00-7cfc1ceeb9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:48.679234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:48.755329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 423/834] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:49.107038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef03f3-179a-43b3-85aa-4e28efaf7305 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.181962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad1bf7-41cd-44cb-be36-60177f9c99ad None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.182275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad1bf7-41cd-44cb-be36-60177f9c99ad None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.182442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad1bf7-41cd-44cb-be36-60177f9c99ad None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.184107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 424/835] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:30:49.189207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8573a9-7515-4b1e-8206-9e873cac222a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.189496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8573a9-7515-4b1e-8206-9e873cac222a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.189831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8573a9-7515-4b1e-8206-9e873cac222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.209498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ad8573a9-7515-4b1e-8206-9e873cac222a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:49.210745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ad8573a9-7515-4b1e-8206-9e873cac222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:49.222315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef03f3-179a-43b3-85aa-4e28efaf7305 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:49.261236 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:49.262310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.262812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.263283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.274039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:49.280455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:49.281438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:30:49.282307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:49.289198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 412/837] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:49.293807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.294565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 425/837] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:30:49.335954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f289-4077-4bd1-8f28-b91491bd4b2a None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.336275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f289-4077-4bd1-8f28-b91491bd4b2a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.336523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f289-4077-4bd1-8f28-b91491bd4b2a None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.338565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 426/838] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:30:49.347464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cac5f-f627-45f6-9b9f-f219b55e8037 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.347464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cac5f-f627-45f6-9b9f-f219b55e8037 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.347464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cac5f-f627-45f6-9b9f-f219b55e8037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.350235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:49.362508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ba9cac5f-f627-45f6-9b9f-f219b55e8037 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:49.363731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ba9cac5f-f627-45f6-9b9f-f219b55e8037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:49.404657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdabeb1-5ad8-4b58-abb3-3354fb612cdf None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:49.440267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 427/839] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:30:49.443442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:49.444064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.444347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.445368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.445368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:49.445634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:49.446994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:49.455821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 413/840] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:49.461805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cac5f-f627-45f6-9b9f-f219b55e8037 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.465297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:49.569630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cac5f-f627-45f6-9b9f-f219b55e8037 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:49.586996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.605463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:49.606097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.606379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.606724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.620186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:49.621751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:49.637967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:49.639690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:49.640878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:49.640878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:49.640878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:49.640878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 428/841] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:49.644816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.698805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63325-5cd0-40e6-8aaf-1a9124401085 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:49.702777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:49.721067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:49.737292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:49.737932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.738320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.738605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.739204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:49.740629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:49.749547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:49.751461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:49.752571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 414/842] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:30:49.753382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.759325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb52820-f488-4595-a7a6-a30623953911 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:49.796905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:49.797512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.797790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.798179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.798822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:49.799127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:49.800734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:49.818418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 429/843] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:49.818418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.868517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1dd9-185a-42a7-9f3c-0b2ec222d3e7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:49.904800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:49.905439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.905723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.906004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.906593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:49.907998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:49.925230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:49.926237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:49.927085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 415/844] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:49.928351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:49.931384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c1d6e-35d3-48be-9e96-5a4b935683b3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:49.949108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:49.976542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:49.977634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:49.977953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:49.978375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:49.979342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:49.979873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:49.980193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:49.981865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:49.991822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 430/845] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:49.992656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.041763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa6536-d18a-4a96-bed3-53fda3a64db3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:50.084642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:50.085659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.086165 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.086751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.096169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:50.097939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:50.101950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849c378-804f-42a1-9bd7-92cc2ece1cf3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:50.111184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:50.112316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 28 08:30:50.113517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:50.115359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 416/846] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:50.116299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.141195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:50.142138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.142570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.142995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.143898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:50.144419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:50.145912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:50.153380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 431/847] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:50.154373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.202843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:50.234939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:50.238107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f90c-6e0d-4d87-bff0-444c20b97b43 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:50.263914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c9750-818a-4a6a-b715-98c46afe41ba None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:50.274926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:50.276558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.276831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.277103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.277734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:50.278036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:50.279383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:50.284029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 417/848] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:30:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:50.284844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.313344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1859b-4471-4f7c-8a42-a5bf79b590d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:50.314350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1859b-4471-4f7c-8a42-a5bf79b590d9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.314927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1859b-4471-4f7c-8a42-a5bf79b590d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.315203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1859b-4471-4f7c-8a42-a5bf79b590d9 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.316006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1859b-4471-4f7c-8a42-a5bf79b590d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:50.316315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1859b-4471-4f7c-8a42-a5bf79b590d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:50.318005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1859b-4471-4f7c-8a42-a5bf79b590d9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:50.343498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 432/849] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 28 08:30:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:50.343498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf939-44f2-4de9-85e2-091bf076c107 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.343498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf939-44f2-4de9-85e2-091bf076c107 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.343498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf939-44f2-4de9-85e2-091bf076c107 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.343498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 433/850] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:50.345177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf939-44f2-4de9-85e2-091bf076c107 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.410339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef52ea-d0ad-449b-afb9-4f582e07d4fc None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:50.448852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072a11c-28ca-4325-ba75-7e2e60b0f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:50.449466 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072a11c-28ca-4325-ba75-7e2e60b0f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.449742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072a11c-28ca-4325-ba75-7e2e60b0f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.450011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072a11c-28ca-4325-ba75-7e2e60b0f4c5 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.450750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072a11c-28ca-4325-ba75-7e2e60b0f4c5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:50.451057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072a11c-28ca-4325-ba75-7e2e60b0f4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:50.452584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072a11c-28ca-4325-ba75-7e2e60b0f4c5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:50.457661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 418/851] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:50.459356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:50.465345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf939-44f2-4de9-85e2-091bf076c107 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:50.468839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28972e0-fd0d-46da-a3c7-c0ce5c2ccb56 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.477511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28972e0-fd0d-46da-a3c7-c0ce5c2ccb56 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.477511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28972e0-fd0d-46da-a3c7-c0ce5c2ccb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.492033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c28972e0-fd0d-46da-a3c7-c0ce5c2ccb56 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:50.493354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c28972e0-fd0d-46da-a3c7-c0ce5c2ccb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:50.512313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:50.513033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.513391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.514837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.527117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:50.599523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 419/852] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:50.618463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:50.620971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:50.733208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:50.737328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 434/853] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 08:30:50.742786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28972e0-fd0d-46da-a3c7-c0ce5c2ccb56 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.865817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28972e0-fd0d-46da-a3c7-c0ce5c2ccb56 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:50.903080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:50.904234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:50.904518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:50.907517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:50.915609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:50.917842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:50.928188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:50.942485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:50.943623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:50.944617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:50.944617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:50.944617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:50.944617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 420/854] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:50.949880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:50.964606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:51.047075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c7346-f210-4e13-bdd6-7efda2e10848 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.070569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975b38-d5fa-4783-9fc4-7c4d62705018 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.085166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.086143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.086633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.087131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.099248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:51.105057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:51.106002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:30:51.106870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:51.111510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 435/855] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:30:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:51.113182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.113975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.114930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.115602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.115878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.116529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:51.116831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.118196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.140631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 421/856] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:51.142145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.189763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:51.229554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:51.237906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bfd72-aa9b-4e46-8a43-af1b10b99fb1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.267743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c82c9-932b-43a3-b8c0-96583780c542 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.283801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.284593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.284973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.285341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.286198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:51.286498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.288008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.301969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 436/857] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:51.303109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.309051 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.309822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.310201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.310575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.318650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.320478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:51.334652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:51.335783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:51.336696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:51.342136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 422/858] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:51.343436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.430954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48af10-c4dd-463a-9795-1d8bec6b9c57 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.455008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:51.467437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.468326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.468326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.468934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.483383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1441-2e15-4daa-97ff-4f246ebac784 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.486068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.487786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:51.504194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:51.505208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:51.506103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:51.506103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:51.506103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:51.511553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 437/859] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:51.512504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.524608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:51.533013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.534803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.534803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.535143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.536050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:51.536537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.538974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.558317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 423/860] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:51.563854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.629924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed88b1-9084-4465-9203-b31941755b5b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.674669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.675850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.676644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.677101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.677975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:51.678508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.680897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.695073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8456316-8c17-41e3-98b8-55d1a86d6850 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.699658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 438/861] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:51.708004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.735949 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.736847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.737192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.737539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.738576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=6717f091388748d8aad2eafcb50fd61a) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:51.738888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.740332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.748255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 424/862] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/role_assignments?user.id=6717f091388748d8aad2eafcb50fd61a&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:51.779307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:51.842768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1dcd-08a2-4427-b32f-af355b2d3eaa None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:51.885397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:51.886280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:51.886557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:51.887368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:51.896283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:51.897743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:51.910298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:51.911350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:51.912355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 439/863] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:51.924126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:51.986722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:52.040316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82a46-5e13-4499-b9fa-e6b9938b9290 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:52.079230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:52.079883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.080173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.080449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.081181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:52.081487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:52.082906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:52.102933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 425/864] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 28 08:30:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:52.108743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:52.215203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:52.222738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c484b3-09f6-46ab-aae1-00d4b12660b3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:52.263330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c00a83-2b87-417b-9ace-4a977e48fc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:52.264314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00a83-2b87-417b-9ace-4a977e48fc92 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.264815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00a83-2b87-417b-9ace-4a977e48fc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.265288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00a83-2b87-417b-9ace-4a977e48fc92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.334868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c00a83-2b87-417b-9ace-4a977e48fc92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:52.336859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c00a83-2b87-417b-9ace-4a977e48fc92 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:52.453107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 440/865] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:30:52.460145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:52.460336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:52.573577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2bb7d-618e-403a-a888-6c226a635d10 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:52.588173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:52.618039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5384f-f88a-4bf7-9998-ed9990bdfde0 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.618259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5384f-f88a-4bf7-9998-ed9990bdfde0 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.618510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5384f-f88a-4bf7-9998-ed9990bdfde0 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.620650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:52.621408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.621765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.622178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.624908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 441/866] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:30:52.626824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e3d8-ef77-418b-ba89-77ea12043c41 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.627766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e3d8-ef77-418b-ba89-77ea12043c41 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.627766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e3d8-ef77-418b-ba89-77ea12043c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.637064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:52.638512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:52.654405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:52.655459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:52.660278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:52.660278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:52.660278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:52.660278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 426/867] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:52.661329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:52.667223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ff15e3d8-ef77-418b-ba89-77ea12043c41 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:52.668491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ff15e3d8-ef77-418b-ba89-77ea12043c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:52.748607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 442/868] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:30:52.749784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f2ff8-5918-4759-9444-133065064dda None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.750071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f2ff8-5918-4759-9444-133065064dda None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.750343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f2ff8-5918-4759-9444-133065064dda None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.751977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 443/869] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:52.760999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5b4d-7102-4afd-9251-f2495132c506 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.761280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5b4d-7102-4afd-9251-f2495132c506 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.761554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5b4d-7102-4afd-9251-f2495132c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.783619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea4121-ffdd-4e66-85f1-2302de4b72b2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:52.788303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ba1e5b4d-7102-4afd-9251-f2495132c506 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:52.793300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ba1e5b4d-7102-4afd-9251-f2495132c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:52.836366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:52.837351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:52.837895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:52.838390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:52.839246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:52.839849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:52.841506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:52.859088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 427/870] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:52.860345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:52.888571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 444/871] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:52.889182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:52.968433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba75d6-d696-4ab9-9b00-36bde09e2751 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:53.003893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:53.004458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:53.004738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:53.005014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:53.012193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:53.013624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:53.024997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:53.026423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:53.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 428/872] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:53.034258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5b4d-7102-4afd-9251-f2495132c506 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:53.035595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:53.097372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:53.140796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:53.163105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a276aa-e74c-4729-acc9-9e82417de264 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:53.171444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5b4d-7102-4afd-9251-f2495132c506 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:53.204387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:53.204671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:53.204998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:53.205279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:53.205524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:53.205626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:53.205875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:53.206217 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:53.206307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:53.206545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:53.206880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:53.208021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:53.208255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:53.221346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 445/873] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:53.222150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:53.299571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 429/874] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:30:53 2022] POST /identity/v3/services => generated 269 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:53.299571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:53.342848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2867b59-e663-4618-a7f2-ef0eaec5dacc None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:53.363372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:53.402285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324fc6-0123-44a8-b9dc-cc55e57cb634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:53.403393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324fc6-0123-44a8-b9dc-cc55e57cb634 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:53.404739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324fc6-0123-44a8-b9dc-cc55e57cb634 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:53.405210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324fc6-0123-44a8-b9dc-cc55e57cb634 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:53.406043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324fc6-0123-44a8-b9dc-cc55e57cb634 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:53.407659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324fc6-0123-44a8-b9dc-cc55e57cb634 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:53.438873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b58a1-d145-4f7e-a5df-db416c00e778 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:53.482161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70afb6-2723-4df4-9973-b99f56c64dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:53.482776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70afb6-2723-4df4-9973-b99f56c64dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:53.483057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70afb6-2723-4df4-9973-b99f56c64dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:53.483330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70afb6-2723-4df4-9973-b99f56c64dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:53.484151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70afb6-2723-4df4-9973-b99f56c64dd3 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=a5f192aca43c40508a5f8fb9611bf5cc) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:53.484499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70afb6-2723-4df4-9973-b99f56c64dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:53.486027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70afb6-2723-4df4-9973-b99f56c64dd3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:53.492968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 430/875] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:53 2022] GET /identity/v3/role_assignments?user.id=a5f192aca43c40508a5f8fb9611bf5cc&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:53.519895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 446/876] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:30:53 2022] POST /identity/v3/services => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:30:54.153079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032903-ef71-4397-91b1-bf62493cfdc0 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:54.153619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032903-ef71-4397-91b1-bf62493cfdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:54.153619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032903-ef71-4397-91b1-bf62493cfdc0 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:54.155202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 431/877] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:54.161983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e9e4-a084-4e2f-a70e-7551b66b81ce None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:54.162447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e9e4-a084-4e2f-a70e-7551b66b81ce None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:54.162618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e9e4-a084-4e2f-a70e-7551b66b81ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:54.183036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-35d3e9e4-a084-4e2f-a70e-7551b66b81ce None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:54.184580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-35d3e9e4-a084-4e2f-a70e-7551b66b81ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:54.264990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 447/878] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:54.541525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90032903-ef71-4397-91b1-bf62493cfdc0 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:54.552928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:54.654304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90032903-ef71-4397-91b1-bf62493cfdc0 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:54.689074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:54.689703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:54.690039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:54.690316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:54.690900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:54.692286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:54.701997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:54.703068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:54.704181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 432/879] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:30:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:54.709316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e9e4-a084-4e2f-a70e-7551b66b81ce None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:54.816339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:54.822598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e9e4-a084-4e2f-a70e-7551b66b81ce None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:54.858526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4298f28-5f00-412a-ad0e-923b607d943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:54.859401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4298f28-5f00-412a-ad0e-923b607d943e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:54.859894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4298f28-5f00-412a-ad0e-923b607d943e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:54.860330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4298f28-5f00-412a-ad0e-923b607d943e None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:54.861111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4298f28-5f00-412a-ad0e-923b607d943e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:54.861563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4298f28-5f00-412a-ad0e-923b607d943e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:54.863082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4298f28-5f00-412a-ad0e-923b607d943e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:54.869515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 448/880] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:30:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:54.875565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:54.951788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:54.995448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78e08-d2e5-4817-835f-078c53eafbcc None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:55.028276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a839ed-28ad-48bd-9e2d-e01099ec2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:55.028887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a839ed-28ad-48bd-9e2d-e01099ec2a2a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:55.029165 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a839ed-28ad-48bd-9e2d-e01099ec2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:55.029435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a839ed-28ad-48bd-9e2d-e01099ec2a2a None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:55.030065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a839ed-28ad-48bd-9e2d-e01099ec2a2a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:55.030368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a839ed-28ad-48bd-9e2d-e01099ec2a2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:55.031745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a839ed-28ad-48bd-9e2d-e01099ec2a2a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:55.037881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 433/881] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:30:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:55.610403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd188ea-9be8-4714-9742-89dbe4ee5a80 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:55.610403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd188ea-9be8-4714-9742-89dbe4ee5a80 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:55.610403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd188ea-9be8-4714-9742-89dbe4ee5a80 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:55.610403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 449/882] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:55.616600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa04f4-8af1-4a91-a5cd-a9fa3b99887b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:55.617349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa04f4-8af1-4a91-a5cd-a9fa3b99887b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:55.617830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa04f4-8af1-4a91-a5cd-a9fa3b99887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:55.637143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a1aa04f4-8af1-4a91-a5cd-a9fa3b99887b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:55.638600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a1aa04f4-8af1-4a91-a5cd-a9fa3b99887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:55.711052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 434/883] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:55.862630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ab64-6139-46ee-942e-0583a72a2c96 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:55.862932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ab64-6139-46ee-942e-0583a72a2c96 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:55.863097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ab64-6139-46ee-942e-0583a72a2c96 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:55.864744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 450/884] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:55.870581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb610-6b7e-412b-8b04-b51ace32f58d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:55.870865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb610-6b7e-412b-8b04-b51ace32f58d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:55.871146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb610-6b7e-412b-8b04-b51ace32f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:55.888542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86cb28-1c24-4169-bf40-7096087c4f93 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:55.889148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86cb28-1c24-4169-bf40-7096087c4f93 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:55.889645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86cb28-1c24-4169-bf40-7096087c4f93 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:55.890847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7f8bb610-6b7e-412b-8b04-b51ace32f58d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:55.891871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 451/885] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:55.892116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7f8bb610-6b7e-412b-8b04-b51ace32f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:55.897153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2364a-f2ab-43a9-bd6a-8cf79b2ba1c6 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:55.897442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2364a-f2ab-43a9-bd6a-8cf79b2ba1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:55.897939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2364a-f2ab-43a9-bd6a-8cf79b2ba1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:55.917882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8dd2364a-f2ab-43a9-bd6a-8cf79b2ba1c6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:55.919454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8dd2364a-f2ab-43a9-bd6a-8cf79b2ba1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:55.984611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:55.993547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 435/886] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:56.003548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb610-6b7e-412b-8b04-b51ace32f58d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.003681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 452/887] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:56.101361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb610-6b7e-412b-8b04-b51ace32f58d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.148240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.148817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.149103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.149435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.150677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.152066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:56.164661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:56.166203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:30:56.167131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:56.170964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 436/888] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Sep 28 08:30:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:56.172860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2364a-f2ab-43a9-bd6a-8cf79b2ba1c6 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.268602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:56.272710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.280102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2364a-f2ab-43a9-bd6a-8cf79b2ba1c6 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.317672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.318434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.318882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.319280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.320354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:56.320776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.324221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.335639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 453/889] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:56.335639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.347871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:56.394809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1e534-cb31-4978-846c-e62daa7b5eb5 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.430557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.431105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.431560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.431816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.442912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:30:56.447503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00945f-1b49-41e4-b1d0-d39e9382498e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:30:56.449723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:56.450635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 437/890] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:56.456793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.485397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.486113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.486460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.486800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.487471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.488833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:56.497683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:56.498662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:56.499536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 454/891] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:56.500333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.521898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:56.579369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aa303-83f1-422f-8d0f-f48d5df40379 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.603634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:56.604551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fac8ec-bb81-44c3-9585-d3458f10aada None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.622281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.623521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.623521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.623521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.624122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:56.624439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.626889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.632786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 438/892] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:56.633414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.644549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.645807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.646093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.646367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.647037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:56.647336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.648728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.657188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 455/893] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:56.657876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.746066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01c0a-06ee-4e5a-9e2f-43abd6e753f9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.746890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:56.767506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334584c1-fc29-4ba2-8c80-4578947e5384 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.782720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.783414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.783853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.784107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.784801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:56.785254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.786584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.795738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 439/894] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:56.795738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.807954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.808559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.808938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.809214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.809913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] RBAC: Adding query filter params (interface=public, service_id=af901de6b7b94000bad643516179e13d, region_id=RegionOne) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:56.810221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.811599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.816863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 456/895] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/endpoints?service_id=af901de6b7b94000bad643516179e13d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:56.820929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.847570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:56.909667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d79c7a-437f-4cdf-9426-78642cbd39dc None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.930956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a58f75-1197-487d-b860-957c45171b90 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:56.957883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.958516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.958791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.959060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.970310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.971503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:56.971837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.972229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:56.972506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:56.972778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:56.973502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:56.973711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:56.975058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:56.980484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 457/896] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:56.981261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:56.991272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:56.992398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:56.995988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:56.995988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:56.995988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:56.995988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 440/897] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:56.995988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:56.998678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:57.096383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ef796-3ba8-4aca-ac7c-2073ba6b8f97 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:57.096804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:57.100817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de8810-1ffe-4579-aabe-83a87e4c4c7e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:57.132174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:57.132788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.133067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.133341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.133945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:57.135890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:57.141733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 458/898] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:30:57.142530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:57.154216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:57.155179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.155690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.155961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.156679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] RBAC: Adding query filter params (interface=public, service_id=6d985d2262e34a9483da9181092435dc, region_id=RegionOne) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:57.156993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:57.158391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:57.169766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 441/899] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:30:56 2022] GET /identity/v3/endpoints?service_id=6d985d2262e34a9483da9181092435dc&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:57.170757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:57.265907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:57.315191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2afe95-5c8d-47dd-8563-92562bdcadd1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:57.318159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698fe5-c28d-440a-9b2a-db88541e236a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:57.366056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cdb0b-4733-4694-a308-e1d5c2f16ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:57.367077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb0b-4733-4694-a308-e1d5c2f16ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.367209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:57.367403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb0b-4733-4694-a308-e1d5c2f16ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.367653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb0b-4733-4694-a308-e1d5c2f16ec1 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.367759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.368023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.368263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cdb0b-4733-4694-a308-e1d5c2f16ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:57.368383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.369575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:57.369877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:57.370256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cdb0b-4733-4694-a308-e1d5c2f16ec1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:57.371348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:57.380029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 442/900] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:30:57 2022] GET /identity/v3/services => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:30:57.380029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08745f-32e3-43a3-9640-641d6c97a96f None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.380029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08745f-32e3-43a3-9640-641d6c97a96f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.380029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08745f-32e3-43a3-9640-641d6c97a96f None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.382438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 443/901] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:57.383856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 459/902] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:57.389517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d646e-440d-4aff-9a13-88ea43558da0 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.390087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d646e-440d-4aff-9a13-88ea43558da0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.390549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d646e-440d-4aff-9a13-88ea43558da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.390937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:57.418396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-e21d646e-440d-4aff-9a13-88ea43558da0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:57.420295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e21d646e-440d-4aff-9a13-88ea43558da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:57.457614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:57.524271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 444/903] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:57.539458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0b41-d177-46a5-baac-70d6615eb3df None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:57.580029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:57.586972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:57.587861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.588337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.588615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.599709 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:57.601156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:30:57.622079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:57.623183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:30:57.624252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:30:57.626477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 460/904] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:30:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:57.632053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d646e-440d-4aff-9a13-88ea43558da0 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:57.740851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d646e-440d-4aff-9a13-88ea43558da0 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:57.782150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:57.782791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:57.783133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:57.783688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:57.784694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:57.785064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:57.786561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:57.809211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 445/905] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 28 08:30:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:57.814722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:57.841911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:57.863579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:57.958841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f914dae-bf3f-4c53-9d16-39ee670cfa07 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:58.002558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b1554-8c49-48eb-a61e-192cc3a16df2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:58.026293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:58.027101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:58.027501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:58.027873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:58.059923 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:58.061158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:58.062188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:58.062844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:58.063960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:58.065534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:58.114133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:58.129374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:58.131168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:58.171481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 446/906] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:30:57 2022] POST /identity/v3/services => generated 241 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:30:58.272565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 461/907] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:30:57 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:30:58.279766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:58.397679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:58.429643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f3ac-5763-4cc7-a18a-6bc2a0603aa9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:58.481882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:58.483351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:58.483911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:58.484385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:58.497320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:58.500138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:30:58.519168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:58.520235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:30:58.521196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:30:58.521196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:30:58.521196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:58.523477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 447/908] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:58.529509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:58.638338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:58.661922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc8d7-0f0e-4317-9c15-479bd5fa6b81 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:58.697507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:58.703440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:58.703440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:58.703440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:58.703440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:58.703440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:58.703440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:58.715004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 462/909] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:58.720356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:58.835438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7c429-5fd1-4610-8829-478fabea9212 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:58.860322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:58.872875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:58.873507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:58.874235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:58.874235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:58.881308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:58.883712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:30:58.895502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:30:58.896483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:30:58.897485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 448/910] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:30:58.903191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:59.014209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92060-c95d-435a-9140-7d52e26f9da2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:59.058140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c85dbc-c006-4471-8310-3e6520816d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:59.058140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c85dbc-c006-4471-8310-3e6520816d81 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:59.058409 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c85dbc-c006-4471-8310-3e6520816d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:59.058481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c85dbc-c006-4471-8310-3e6520816d81 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:59.063443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c85dbc-c006-4471-8310-3e6520816d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:59.063443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c85dbc-c006-4471-8310-3e6520816d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:59.063443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c85dbc-c006-4471-8310-3e6520816d81 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:59.074615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 463/911] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:30:59.080861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:59.194347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345434-f7ae-4b11-bfc9-dd90a03d5652 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:30:59.235824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c9931-9f6b-41e9-a8e1-5fde876cfa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:30:59.236791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c9931-9f6b-41e9-a8e1-5fde876cfa88 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:59.237267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c9931-9f6b-41e9-a8e1-5fde876cfa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:59.237733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c9931-9f6b-41e9-a8e1-5fde876cfa88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:59.238670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c9931-9f6b-41e9-a8e1-5fde876cfa88 None admin] RBAC: Adding query filter params (role.id=e0779a37914d4626abe920666b1b7f2d, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=a5f192aca43c40508a5f8fb9611bf5cc) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:30:59.239195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c9931-9f6b-41e9-a8e1-5fde876cfa88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:30:59.240827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c9931-9f6b-41e9-a8e1-5fde876cfa88 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:30:59.246933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 449/912] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:30:59 2022] GET /identity/v3/role_assignments?user.id=a5f192aca43c40508a5f8fb9611bf5cc&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=e0779a37914d4626abe920666b1b7f2d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:30:59.502285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97056c-5c9e-4899-8f17-40e6bc9b217e None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:59.502473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97056c-5c9e-4899-8f17-40e6bc9b217e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:59.502745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97056c-5c9e-4899-8f17-40e6bc9b217e None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:59.504373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 464/913] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:59.510962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe50d-8833-48ea-b7b6-ce7e138c95f9 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:59.511251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe50d-8833-48ea-b7b6-ce7e138c95f9 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:59.511557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe50d-8833-48ea-b7b6-ce7e138c95f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:59.531004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d96fe50d-8833-48ea-b7b6-ce7e138c95f9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:59.532254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d96fe50d-8833-48ea-b7b6-ce7e138c95f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:59.580740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:59.605577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 450/914] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:30:59.683843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7d7e-1005-4615-86d9-1cdc3eae5e72 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:59.684273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7d7e-1005-4615-86d9-1cdc3eae5e72 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:59.684652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7d7e-1005-4615-86d9-1cdc3eae5e72 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:59.686344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 465/915] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:30:59.691670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329abb2-cf25-48d2-bbd9-055f14bd4f55 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:30:59.692065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329abb2-cf25-48d2-bbd9-055f14bd4f55 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:30:59.692524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329abb2-cf25-48d2-bbd9-055f14bd4f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:30:59.711443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0329abb2-cf25-48d2-bbd9-055f14bd4f55 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:30:59.712866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0329abb2-cf25-48d2-bbd9-055f14bd4f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:30:59.789817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 451/916] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:30:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:30:59.908677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a7d7e-1005-4615-86d9-1cdc3eae5e72 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:30:59.927741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:00.028305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a7d7e-1005-4615-86d9-1cdc3eae5e72 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.063540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.064093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.064369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.064641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.065220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.066578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.070932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329abb2-cf25-48d2-bbd9-055f14bd4f55 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:00.077440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:00.078390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:00.079317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 466/917] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Sep 28 08:30:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:00.086238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:00.178711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:00.197692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329abb2-cf25-48d2-bbd9-055f14bd4f55 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.209583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:00.212355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079e554-83ae-48d4-ad20-5ace2a8b673d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.238754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.239603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.239978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.240316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.241006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.243006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.250941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.252500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.253013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:00.253237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:00.254388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 28 08:31:00.255459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:00.256941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.257765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:00.263450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.263581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 452/918] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:31:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:00.265112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.265569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:00.271819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 467/919] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:31:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:00.277991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:00.389434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6575-eb83-4985-8d23-d2ade821931b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.393164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01747ef-e962-4e1e-a77c-3f8e9a8e9ced None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.436541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.437677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.438218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.438721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.439710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:00.439952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.440428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.440597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.440846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.441120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.441747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:00.442052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.442949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.443390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.454720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 453/920] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:31:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:00.454882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 468/921] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:31:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:00.459280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:00.460545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:00.467105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:00.499680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:00.590252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beab2d6-72ce-49c3-a17d-e47d9c4a112f None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.590621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940011-9d2e-4702-9979-e12607c95a51 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.629522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba129eb-fea2-488e-9398-645749cfd53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.630130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba129eb-fea2-488e-9398-645749cfd53c None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.630414 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba129eb-fea2-488e-9398-645749cfd53c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.630698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba129eb-fea2-488e-9398-645749cfd53c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.631368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba129eb-fea2-488e-9398-645749cfd53c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.631810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad817-176e-4f39-a7fe-511206f7cd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.632671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad817-176e-4f39-a7fe-511206f7cd1b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.632862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba129eb-fea2-488e-9398-645749cfd53c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.633467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad817-176e-4f39-a7fe-511206f7cd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.633976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad817-176e-4f39-a7fe-511206f7cd1b None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.635625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ad817-176e-4f39-a7fe-511206f7cd1b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:00.636123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ad817-176e-4f39-a7fe-511206f7cd1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.637700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ad817-176e-4f39-a7fe-511206f7cd1b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.648171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 454/922] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 28 08:31:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:00.649535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbdcbd-c52a-451e-938e-d897847349a0 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.649941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbdcbd-c52a-451e-938e-d897847349a0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.650447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbdcbd-c52a-451e-938e-d897847349a0 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.651984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 455/923] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:00.652659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbdcbd-c52a-451e-938e-d897847349a0 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:00.723499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 469/924] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:31:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:00.723499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc5eb-7168-4ebb-afa5-d0a1717e4cf8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.723499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc5eb-7168-4ebb-afa5-d0a1717e4cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.723499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fc5eb-7168-4ebb-afa5-d0a1717e4cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.752560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-dc5fc5eb-7168-4ebb-afa5-d0a1717e4cf8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:00.753737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-dc5fc5eb-7168-4ebb-afa5-d0a1717e4cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:00.784720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:00.818283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbdcbd-c52a-451e-938e-d897847349a0 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:00.834704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:00.853535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 470/925] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:00.868377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:00.869886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:00.870323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:00.870745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:00.871759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:00.873365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:00.984251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 456/926] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:31:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:01.137614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc5eb-7168-4ebb-afa5-d0a1717e4cf8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:01.250422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fc5eb-7168-4ebb-afa5-d0a1717e4cf8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:01.292566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eff8c-86c5-4b4a-bcfa-f9af520987a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:01.293193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eff8c-86c5-4b4a-bcfa-f9af520987a9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:01.293471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eff8c-86c5-4b4a-bcfa-f9af520987a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:01.293742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eff8c-86c5-4b4a-bcfa-f9af520987a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:01.294329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770eff8c-86c5-4b4a-bcfa-f9af520987a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:01.295821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770eff8c-86c5-4b4a-bcfa-f9af520987a9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-770eff8c-86c5-4b4a-bcfa-f9af520987a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:01.308288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:01.309324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:01.310178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 471/927] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:31:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:01.315557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:01.438510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d9d83-272e-4a0e-9b9f-6804e9d53c4c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:01.476004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc868b-5a68-434f-b457-d5fa712dc663 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:01.476349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc868b-5a68-434f-b457-d5fa712dc663 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:01.479441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc868b-5a68-434f-b457-d5fa712dc663 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:01.479568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:01.479568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:01.479568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:01.479796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 472/928] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:31:01.479873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:01.479873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:01.479873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:01.480666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:01.484589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cada-98d2-4cb5-bff3-ee05e6022406 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:01.484877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cada-98d2-4cb5-bff3-ee05e6022406 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:01.485152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cada-98d2-4cb5-bff3-ee05e6022406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:01.486437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 457/929] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:01.491731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:01.511458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-7556cada-98d2-4cb5-bff3-ee05e6022406 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:01.512593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:01.514426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7556cada-98d2-4cb5-bff3-ee05e6022406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:01.581744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:01.610076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 473/930] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:01.619442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb86255-51bf-48af-a435-9d2c2a4e7002 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:01.656588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:01.657202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:01.657487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:01.657812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:01.658457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:01.658765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:01.660200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:01.669518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 458/931] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:01.672713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cada-98d2-4cb5-bff3-ee05e6022406 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:01.787102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cada-98d2-4cb5-bff3-ee05e6022406 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:01.825015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:01.825991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:01.826474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:01.826967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:01.827908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] RBAC: Adding query filter params (interface=public, service_id=4394499f1a824db7bc3372b303f4ad49, region_id=RegionOne) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:01.828431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:01.829992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:01.835800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 474/932] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:31:01 2022] GET /identity/v3/endpoints?service_id=4394499f1a824db7bc3372b303f4ad49&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:01.843525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:01.892713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:01.953705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:01.964596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:01.977460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b369af-0bdc-41d0-aa57-20914e91a480 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:02.022769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:02.023855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:02.024357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:02.024928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:02.025742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:02.027964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:02.034383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27f77c-6a5d-4cd3-a369-67b610e8fd88 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:02.043787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 459/933] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:31:01 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:31:02.086582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:02.087403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:02.088334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:02.088628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:02.101049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:02.113159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:02.114208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:02.115102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:02.116306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 475/934] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 28 08:31:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:02.120528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:02.238782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03459dca-4bdf-42dd-ae70-e0b4a4ffea90 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:02.275754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:02.279452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:02.279452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:02.279452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:02.279452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:02.279452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:02.279452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:02.287727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 460/935] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 28 08:31:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:02.294106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:02.403216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cace1-d6d8-4740-afd4-d821bdd0ba15 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:02.405606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:02.442001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:02.442001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:02.442001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:02.442001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:02.453221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:02.454685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:02.469714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:02.470893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:02.471929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:02.471929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:02.471929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:02.475442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 476/936] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:02.484760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:02.495816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:02.599391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92377cd-c642-4dd6-b563-7040b70234b3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:02.636878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:02.637494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:02.637775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:02.638047 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:02.638694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:02.638995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:02.640380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:02.657860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 461/937] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:02.660501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:02.773995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608e7e2-08e9-408c-872b-d60f8fe6e0c0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:02.812590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:02.813294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:02.813576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:02.813850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:02.824837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:02.828248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:31:02.847790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:02.848811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:02.849849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 477/938] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:31:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:02.855380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:02.925942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:02.967162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d17386-a667-4b20-89a2-0ba68dcc45f6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:03.008270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59229bac-c13b-4297-ba1f-40d472f7479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:03.008906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59229bac-c13b-4297-ba1f-40d472f7479e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.009736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59229bac-c13b-4297-ba1f-40d472f7479e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.010011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59229bac-c13b-4297-ba1f-40d472f7479e None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.011075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59229bac-c13b-4297-ba1f-40d472f7479e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:03.011383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59229bac-c13b-4297-ba1f-40d472f7479e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:03.012880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59229bac-c13b-4297-ba1f-40d472f7479e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:03.037289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 462/939] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 28 08:31:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:03.038880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:03.065181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:03.122831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e2c2-08d3-4311-b6ae-7e24f408a0c1 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.123200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e2c2-08d3-4311-b6ae-7e24f408a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.123608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e2c2-08d3-4311-b6ae-7e24f408a0c1 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.125352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 463/940] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:31:03.130273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608fd9-f79f-4b9a-8a8a-c4f328537854 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.130798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608fd9-f79f-4b9a-8a8a-c4f328537854 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.131314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35608fd9-f79f-4b9a-8a8a-c4f328537854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.150663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-35608fd9-f79f-4b9a-8a8a-c4f328537854 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:03.152409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-35608fd9-f79f-4b9a-8a8a-c4f328537854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:03.157878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030b900-8b59-4846-b5a3-658554e936aa None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:03.204885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ac0e0-15a3-4999-ab13-24f321135702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:03.205516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac0e0-15a3-4999-ab13-24f321135702 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.205797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac0e0-15a3-4999-ab13-24f321135702 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.206069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ac0e0-15a3-4999-ab13-24f321135702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.221620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ac0e0-15a3-4999-ab13-24f321135702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:03.223404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ac0e0-15a3-4999-ab13-24f321135702 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:03.235887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 464/941] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-a03ac0e0-15a3-4999-ab13-24f321135702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:03.242263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:03.243309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:03.245070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:03.245070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:03.245070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:03.248906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 478/942] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:03.250508 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35608fd9-f79f-4b9a-8a8a-c4f328537854 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:03.309549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:03.349505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9eb65-cd06-49ef-b516-f56602b74740 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.350139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9eb65-cd06-49ef-b516-f56602b74740 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.350376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9eb65-cd06-49ef-b516-f56602b74740 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.352470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 479/943] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:03.360663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6749-053e-4659-ba42-d5f40719a610 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.361058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6749-053e-4659-ba42-d5f40719a610 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.361311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35608fd9-f79f-4b9a-8a8a-c4f328537854 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:03.361517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf6749-053e-4659-ba42-d5f40719a610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.391518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-93bf6749-053e-4659-ba42-d5f40719a610 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:03.391518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-93bf6749-053e-4659-ba42-d5f40719a610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:03.403924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:03.404652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.405029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.405403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.406143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:03.406542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:03.408052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:03.420658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 465/944] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:03.426527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:03.467384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:03.478996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 480/945] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:03.527336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6749-053e-4659-ba42-d5f40719a610 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:03.541948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa12c3-20f6-4c95-a492-c65fc495fa20 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:03.558729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:03.582593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:03.583611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.584101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.584552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.593093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:03.594770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:31:03.616124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:03.617075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:03.618005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:03.632424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 466/946] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:03.636224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:03.721498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf6749-053e-4659-ba42-d5f40719a610 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:03.776638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:03.777269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.777553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.777863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.778405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:03.779804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:03.782885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744bee-0dd7-4774-a25b-e71b600bbe34 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:03.788865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:03.790195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:03.791068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:03.795737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 481/947] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:03.797149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:03.843181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:03.844283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.844657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.845142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.846219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:03.846631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:03.848417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:03.864857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 467/948] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:03.864857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:03.889257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:03.916764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:03.940781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2eabc-7533-48b6-83a2-6404160eef38 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:03.986127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:03.986310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:03.986538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:03.987243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:03.987366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:03.989377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:03.993186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING keystone.server.flask.common [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 28 08:31:03.999118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15391762-c6ef-4a19-ac99-82740a839ffb None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:04.042394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:04.042983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:04.043268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:04.043596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:04.044234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:04.044570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:04.046137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:04.049916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.sql.core [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 08:31:04.049916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 28 08:31:04.049916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [parameters: {'id': 'bf7f0be042d147418083344302f1796c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 28 08:31:04.049916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81845) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 08:31:04.051312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 468/949] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:31:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:04.052151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf7f0be042d147418083344302f1796c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf7f0be042d147418083344302f1796c. Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application conn.query(q) Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 08:31:04.074923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application result.read() Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 28 08:31:04.075851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application next(self.gen) Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application yield resource Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application next(self.gen) Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise self.value Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application session.commit() Sep 28 08:31:04.076849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self.session.flush() Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application compat.raise_( Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 08:31:04.077879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 08:31:04.078822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application conn.query(q) Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application result.read() Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 08:31:04.081210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [parameters: {'id': 'bf7f0be042d147418083344302f1796c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:04.082148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:04.083139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf7f0be042d147418083344302f1796c. Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 482/950] 10.222.0.57 () {60 vars in 1140 bytes} [Wed Sep 28 08:31:03 2022] POST /identity/v3/projects => generated 262 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:04.084309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:04.185542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:04.190542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16355897-b6e1-41ad-bc15-0c98fb1f9ed0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:04.236012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a1f98-56e1-43ca-bfa2-027e85676613 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:04.237117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac09f9-cd53-43bb-9109-bdc6b62c7be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:04.237942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac09f9-cd53-43bb-9109-bdc6b62c7be5 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:04.238224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac09f9-cd53-43bb-9109-bdc6b62c7be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:04.239359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac09f9-cd53-43bb-9109-bdc6b62c7be5 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/a5f192aca43c40508a5f8fb9611bf5cc/roles/e0779a37914d4626abe920666b1b7f2d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:04.241972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac09f9-cd53-43bb-9109-bdc6b62c7be5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=a5f192aca43c40508a5f8fb9611bf5cc, role_id=e0779a37914d4626abe920666b1b7f2d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:04.244107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac09f9-cd53-43bb-9109-bdc6b62c7be5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:04.258654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:04.278837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:04.279513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:04.279795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:04.280067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:04.280713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:04.281047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:04.282626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:04.291677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 483/951] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:31:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:04.292514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:04.356253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 469/952] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:31:04 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/a5f192aca43c40508a5f8fb9611bf5cc/roles/e0779a37914d4626abe920666b1b7f2d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:31:04.389277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667266c-7a20-47d1-b3e7-01c241d7f374 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:04.389624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667266c-7a20-47d1-b3e7-01c241d7f374 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:04.389931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667266c-7a20-47d1-b3e7-01c241d7f374 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:04.391677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 470/953] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:04.397608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb1cf-fe45-4770-b315-1b7daa2d46eb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:04.397907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb1cf-fe45-4770-b315-1b7daa2d46eb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:04.398186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb1cf-fe45-4770-b315-1b7daa2d46eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:04.440162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-affcb1cf-fe45-4770-b315-1b7daa2d46eb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:04.441442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-affcb1cf-fe45-4770-b315-1b7daa2d46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:04.506050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5532d-a0f5-476b-acc3-c6010dafa216 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:04.577213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 471/954] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:04.585229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:04.585883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:04.586159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:04.586431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:04.600930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:04.602404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:31:04.631941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:04.633086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:04.634887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 484/955] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:04.640514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb1cf-fe45-4770-b315-1b7daa2d46eb None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:04.766093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:04.779110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb1cf-fe45-4770-b315-1b7daa2d46eb None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:04.815260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:04.817393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:04.817393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:04.817393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:04.817393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:04.817393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:04.818792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:04.840078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 472/956] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:31:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:04.891653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:04.971122 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:05.048936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69659-55fd-490d-9a4f-9f6b4543420b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:05.094521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:05.095557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:05.096168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:05.096675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:05.097457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:05.099087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:05.108669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:05.109882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:05.110745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:05.113607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 485/957] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:31:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:05.120660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:05.245659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904fb4d-638f-4ee1-b81f-485faa519815 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:05.281245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:05.282253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:05.282729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:05.283196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:05.284054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:05.284551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:05.286218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:05.292215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 473/958] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:05.298091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:05.416695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249313b-43f7-4712-8342-eebebe745f42 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:05.439769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:05.453519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f99d2b-221e-4904-8368-5ae16a12408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:05.454463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f99d2b-221e-4904-8368-5ae16a12408c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:05.454936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f99d2b-221e-4904-8368-5ae16a12408c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:05.455396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f99d2b-221e-4904-8368-5ae16a12408c None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:05.456259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f99d2b-221e-4904-8368-5ae16a12408c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:05.456775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f99d2b-221e-4904-8368-5ae16a12408c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:05.458317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f99d2b-221e-4904-8368-5ae16a12408c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:05.466240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 486/959] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:05.472500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:05.489302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:05.580785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ca6fe-92ed-4b71-a7d2-bb3933265ee7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:05.616315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf07d6b-3a79-465c-9248-602232ad2d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:05.616926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf07d6b-3a79-465c-9248-602232ad2d85 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:05.617232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf07d6b-3a79-465c-9248-602232ad2d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:05.623441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf07d6b-3a79-465c-9248-602232ad2d85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:05.623441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf07d6b-3a79-465c-9248-602232ad2d85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:05.623441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf07d6b-3a79-465c-9248-602232ad2d85 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:05.717584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 474/960] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:31:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:06.828532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017d33-5a36-4ae3-a1f2-c7e9dadd13b4 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:06.829052 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017d33-5a36-4ae3-a1f2-c7e9dadd13b4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:06.829163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017d33-5a36-4ae3-a1f2-c7e9dadd13b4 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:06.830807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 487/961] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:06.836601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83999b-1c5e-4288-ad59-f0183c23fc96 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:06.837673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83999b-1c5e-4288-ad59-f0183c23fc96 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:06.837765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83999b-1c5e-4288-ad59-f0183c23fc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:06.860736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9b83999b-1c5e-4288-ad59-f0183c23fc96 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:06.861927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9b83999b-1c5e-4288-ad59-f0183c23fc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:06.873493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b18ed-4ec1-416f-829f-47ff82efed26 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:06.873833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b18ed-4ec1-416f-829f-47ff82efed26 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:06.874833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b18ed-4ec1-416f-829f-47ff82efed26 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:06.876723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 488/962] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:31:06.881339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3db05-8bae-4188-9457-249b147d704c None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:06.881867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3db05-8bae-4188-9457-249b147d704c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:06.882343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3db05-8bae-4188-9457-249b147d704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:06.910226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-47f3db05-8bae-4188-9457-249b147d704c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:06.912673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-47f3db05-8bae-4188-9457-249b147d704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:06.952566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:06.977376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 475/963] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:07.030241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 489/964] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:07.290033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83999b-1c5e-4288-ad59-f0183c23fc96 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:07.350975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3db05-8bae-4188-9457-249b147d704c None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:07.426008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83999b-1c5e-4288-ad59-f0183c23fc96 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:07.475599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acecb5a-3aef-4d5e-a55f-2db11ab6fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:07.476223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecb5a-3aef-4d5e-a55f-2db11ab6fecf None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:07.476506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecb5a-3aef-4d5e-a55f-2db11ab6fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:07.476779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecb5a-3aef-4d5e-a55f-2db11ab6fecf None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:07.478415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acecb5a-3aef-4d5e-a55f-2db11ab6fecf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:07.480593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acecb5a-3aef-4d5e-a55f-2db11ab6fecf None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:07.486200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:07.489770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3db05-8bae-4188-9457-249b147d704c None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:07.529514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df85e0-595e-43a9-8347-32f6e6a0ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:07.530176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df85e0-595e-43a9-8347-32f6e6a0ed00 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:07.530450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df85e0-595e-43a9-8347-32f6e6a0ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:07.530799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df85e0-595e-43a9-8347-32f6e6a0ed00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:07.542521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df85e0-595e-43a9-8347-32f6e6a0ed00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-b7df85e0-595e-43a9-8347-32f6e6a0ed00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:07.547385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:07.554135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 490/965] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 28 08:31:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:07.555007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0fb54-7ea6-4565-b021-323e77c7341f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:07.556589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0fb54-7ea6-4565-b021-323e77c7341f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:07.556589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0fb54-7ea6-4565-b021-323e77c7341f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:07.556589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 491/966] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:07.557852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0fb54-7ea6-4565-b021-323e77c7341f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:07.588608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 476/967] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:31:07 2022] POST /identity/v3/services => generated 242 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:07.588608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc33d8-9a7b-49f5-a9a1-6ea80d541cf6 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:07.588608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc33d8-9a7b-49f5-a9a1-6ea80d541cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:07.588608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc33d8-9a7b-49f5-a9a1-6ea80d541cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:07.613358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c0bc33d8-9a7b-49f5-a9a1-6ea80d541cf6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:07.615072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c0bc33d8-9a7b-49f5-a9a1-6ea80d541cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:07.731291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:07.782501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 477/968] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:07.790706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0fb54-7ea6-4565-b021-323e77c7341f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:07.840943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:07.841544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:07.841788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:07.842865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:07.842865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:07.843051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:07.844408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:07.856925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 492/969] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 28 08:31:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:07.861637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc33d8-9a7b-49f5-a9a1-6ea80d541cf6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:07.976531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc33d8-9a7b-49f5-a9a1-6ea80d541cf6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.014888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.015560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.015837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.016104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.027388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:08.029024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:08.046393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:08.047389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:08.048476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:08.048476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:08.048476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:08.048476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 478/970] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:08.053477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:08.091227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:08.109491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:08.148839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:08.201781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185545c4-ec82-4c0d-b18a-442d87de79d0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.224734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89b1b-be4e-4566-b065-595e360f1b4d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.252198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb87dcf-ce0f-48b5-8514-4dcc39fc2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.253058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87dcf-ce0f-48b5-8514-4dcc39fc2bde None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.253345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87dcf-ce0f-48b5-8514-4dcc39fc2bde None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.253617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87dcf-ce0f-48b5-8514-4dcc39fc2bde None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.254371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb87dcf-ce0f-48b5-8514-4dcc39fc2bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:08.254977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb87dcf-ce0f-48b5-8514-4dcc39fc2bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:08.258088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb87dcf-ce0f-48b5-8514-4dcc39fc2bde None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:08.266288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.266995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.267352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.267723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.268441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:08.269866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:08.272682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING keystone.server.flask.common [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 28 08:31:08.277533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 493/971] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:08.278925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466a5f-04d7-416c-8290-01157aa42014 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.279227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466a5f-04d7-416c-8290-01157aa42014 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.279577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466a5f-04d7-416c-8290-01157aa42014 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.280971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 494/972] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:08.281507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95466a5f-04d7-416c-8290-01157aa42014 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:08.330654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.sql.core [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 08:31:08.330654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 28 08:31:08.330654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [parameters: {'user_id': '3887f228a9584b8b986d1fdfd6595212', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 28 08:31:08.330654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81844) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-215fd7e8-4693-4d4c-9b5d-025a9ae76e94 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application conn.query(q) Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result.read() Sep 28 08:31:08.338182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 08:31:08.339105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application next(self.gen) Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application yield resource Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application next(self.gen) Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.session.rollback() Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.force_reraise() Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise self.value Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application session.commit() Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 28 08:31:08.340258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._prepare_impl() Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.session.flush() Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._flush(objects) Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application compat.raise_( Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application flush_context.execute() Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rec.execute(self) Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 28 08:31:08.341204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 28 08:31:08.342769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result = self._query(query) Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application conn.query(q) Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application result.read() Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 28 08:31:08.344814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [parameters: {'user_id': '3887f228a9584b8b986d1fdfd6595212', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:08.346895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 28 08:31:08.348882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 479/973] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 28 08:31:08 2022] POST /identity/v3/users => generated 160 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22602ba0-f76f-44ea-9c17-602f46552075 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22602ba0-f76f-44ea-9c17-602f46552075 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.351116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22602ba0-f76f-44ea-9c17-602f46552075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.372234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-22602ba0-f76f-44ea-9c17-602f46552075 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:08.374224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-22602ba0-f76f-44ea-9c17-602f46552075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:08.377600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:08.397967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95466a5f-04d7-416c-8290-01157aa42014 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.441753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.442390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.442679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.443584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.453038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:08.454504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:31:08.470906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:08.472021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 495/974] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:31:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:08.473124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:08.483911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 480/975] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:08.484789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22602ba0-f76f-44ea-9c17-602f46552075 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:08.524905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:08.629461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22602ba0-f76f-44ea-9c17-602f46552075 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.660958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c40ed-6e95-4d17-ae0b-4b68e1dfba33 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.676428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.677392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.677947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.678570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.679594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:08.680123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:08.682646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:08.706743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 481/976] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 28 08:31:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:08.713257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:08.724886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.728174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.729717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.730258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.747620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:08.749911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:31:08.770186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:08.771321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 28 08:31:08.772364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:08.775588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 496/977] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:31:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:08.776683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:08.780487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:08.841661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:08.863475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bda3bd-97f4-4b75-a5bc-ff9797ccd1ce None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.901973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c8639-890d-43fe-b3dd-dcfe5252abac None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:08.919819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.920447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.920733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.921008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.954159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:08.954972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:08.955255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:08.955587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:08.956493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:08.958137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:08.970435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:08.971597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:08.972657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:08.976705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 497/978] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:31:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:08.978777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.018974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.020636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.079502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:09.121762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:09.126363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871e09c-2aae-4adb-8f4d-1eadbe5ae159 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.151008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 482/979] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:08 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 08:31:09.152124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.170227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:09.171317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:09.171803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:09.172384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:09.173743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:09.174210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.175838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.231621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 498/980] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 28 08:31:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:09.233331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.292936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efb4f6-5a2f-41e5-a6d1-e921db45ccd3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.348395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:09.349031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:09.349317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:09.349596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:09.350244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:09.350550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.352857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.360171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 483/981] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:09.371210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.448667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c52a7-bd0b-43a7-88d5-83dd786c2227 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.462895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:09.486171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:09.501121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:09.501876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:09.502231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:09.502580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:09.518457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.521790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:09.543729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:09.544764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:09.545687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:09.545687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:09.545687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:09.547476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 499/982] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:09.552799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248e431-0d90-4775-b8f9-2fd392702599 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.553306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.608585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:09.609259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:09.609543 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:09.609814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:09.610451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:09.610755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.614245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.625109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 484/983] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:09.631968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.694953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff691e-dde7-4c60-af58-e08bb4a6782d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.750463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:09.751453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:09.751966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:09.752599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:09.753876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:09.754405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.756585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.762821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdf160-865f-427e-afa2-e49bfba02c17 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.776284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 500/984] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:09.780086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:09.781728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.806330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:09.807336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:09.807707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:09.807987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:09.808746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] RBAC: Adding query filter params (interface=admin, service_id=4394499f1a824db7bc3372b303f4ad49, region_id=RegionOne) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:09.809065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.810678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.819599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 485/985] 10.222.0.57 () {56 vars in 1249 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/endpoints?service_id=4394499f1a824db7bc3372b303f4ad49&interface=admin®ion_id=RegionOne => generated 193 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:09.824094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:09.828819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:09.908163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b622-b3f4-4753-9b51-b56b931bf486 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.957781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:09.958523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:09.958802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:09.959075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:09.967387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:09.968771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29dee-6cdb-4118-b0dd-c02c2d05eed8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:09.969196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:31:09.982201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:09.983522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:09.984712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:09.988513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 501/986] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:09.989210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:10.019239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887451d8-767e-464e-8faa-7239eaf54737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:10.019990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887451d8-767e-464e-8faa-7239eaf54737 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.020375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887451d8-767e-464e-8faa-7239eaf54737 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.021038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887451d8-767e-464e-8faa-7239eaf54737 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.021769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887451d8-767e-464e-8faa-7239eaf54737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:10.023225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887451d8-767e-464e-8faa-7239eaf54737 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:10.031033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 486/987] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/services => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:31:10.052268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462360-53b2-4f00-8d45-0fa9b5c6cdf0 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.052562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462360-53b2-4f00-8d45-0fa9b5c6cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.052840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20462360-53b2-4f00-8d45-0fa9b5c6cdf0 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.054206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 487/988] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:31:10.060921 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86023-3744-414c-a9f2-a5ceb073bc8d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.061195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86023-3744-414c-a9f2-a5ceb073bc8d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.061474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86023-3744-414c-a9f2-a5ceb073bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.085556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-45f86023-3744-414c-a9f2-a5ceb073bc8d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:10.088742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-45f86023-3744-414c-a9f2-a5ceb073bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:10.127932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:10.131789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:10.142380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a5a2d-de03-43ff-9783-b1f26fad3687 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:10.179470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 488/989] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:10.188678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:10.189310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.189591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.189864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.190575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:10.190881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:10.192397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:10.205405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 502/990] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:10.212385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86023-3744-414c-a9f2-a5ceb073bc8d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:10.336231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86023-3744-414c-a9f2-a5ceb073bc8d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:10.373145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:10.373846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.375557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.375557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.375557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] RBAC: Adding query filter params (role.id=e0779a37914d4626abe920666b1b7f2d, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=a5f192aca43c40508a5f8fb9611bf5cc) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:10.375557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:10.380135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:10.385021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 489/991] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:10 2022] GET /identity/v3/role_assignments?user.id=a5f192aca43c40508a5f8fb9611bf5cc&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=e0779a37914d4626abe920666b1b7f2d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:10.472151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:10.588400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2302fa7-c2fc-47a4-86c5-88e90c3c17eb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:10.634661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:10.635609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.635886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.636576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.636751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:10.638123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:10.655455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:10.656520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:10.657386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 503/992] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:10.659608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:10.699737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:10.776327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60ab1a-b09a-44a8-93df-bd0ead038c01 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:10.818606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:10.819626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.820118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.820622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.821512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:10.822112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:10.823729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:10.834027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 490/993] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:31:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:10.835013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:10.859609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:10.954606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868479cf-b258-4fa9-981d-2e5a17b6ee08 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:10.993487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:10.994482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:10.995222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:10.995739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:10.996601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:10.997107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:10.998701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:11.011025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 504/994] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:31:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:11.012017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:11.123395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:11.130259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30fb91-a28d-4c55-bb0c-467840a76696 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:11.167837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b77ce1-cec8-4766-a6f8-23fec4877db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:11.168842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77ce1-cec8-4766-a6f8-23fec4877db6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:11.169303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77ce1-cec8-4766-a6f8-23fec4877db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:11.169752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77ce1-cec8-4766-a6f8-23fec4877db6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:11.170633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b77ce1-cec8-4766-a6f8-23fec4877db6 None admin] RBAC: Adding query filter params (interface=public, service_id=41c10ee6dd074723802aa7c6f90e4c1e, region_id=RegionOne) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:11.171132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b77ce1-cec8-4766-a6f8-23fec4877db6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:11.172959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b77ce1-cec8-4766-a6f8-23fec4877db6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:11.179389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 491/995] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:31:11 2022] GET /identity/v3/endpoints?service_id=41c10ee6dd074723802aa7c6f90e4c1e&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:11.187304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:11.292364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:11.311711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3712-049d-4cab-b1c6-31f336ca66d1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:11.351987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e82eba-af80-4fa5-92ac-e86e1cd22860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:11.353085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82eba-af80-4fa5-92ac-e86e1cd22860 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:11.353598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82eba-af80-4fa5-92ac-e86e1cd22860 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:11.354271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e82eba-af80-4fa5-92ac-e86e1cd22860 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:11.355077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82eba-af80-4fa5-92ac-e86e1cd22860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:11.356720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e82eba-af80-4fa5-92ac-e86e1cd22860 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:11.373763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 505/996] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:31:11 2022] GET /identity/v3/services => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:31:12.375350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d5eab-3cd2-4384-b8ef-1f5df7890181 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:12.375350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d5eab-3cd2-4384-b8ef-1f5df7890181 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:12.375350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d5eab-3cd2-4384-b8ef-1f5df7890181 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:12.380405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 492/997] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:12.381964 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8118b-9337-4f90-bc91-8eedb67ec6ed None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:12.382367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8118b-9337-4f90-bc91-8eedb67ec6ed None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:12.382543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8118b-9337-4f90-bc91-8eedb67ec6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:12.404257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-eca8118b-9337-4f90-bc91-8eedb67ec6ed None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:12.405454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-eca8118b-9337-4f90-bc91-8eedb67ec6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:12.484324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 506/998] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:12.687079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec592a-4cce-4795-a7bf-e7c4f28d2a1d None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:12.687716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec592a-4cce-4795-a7bf-e7c4f28d2a1d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:12.688196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec592a-4cce-4795-a7bf-e7c4f28d2a1d None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:12.689970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 493/999] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:12.696688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bea1c-aab9-4a53-9e6c-94cc2cca5842 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:12.697310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bea1c-aab9-4a53-9e6c-94cc2cca5842 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:12.698017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bea1c-aab9-4a53-9e6c-94cc2cca5842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:12.717458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-854bea1c-aab9-4a53-9e6c-94cc2cca5842 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:12.718999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-854bea1c-aab9-4a53-9e6c-94cc2cca5842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:12.752695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec592a-4cce-4795-a7bf-e7c4f28d2a1d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:12.803460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 507/1000] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:12.866492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec592a-4cce-4795-a7bf-e7c4f28d2a1d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:12.902552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:12.903184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:12.903483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:12.903760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:12.904341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:12.905749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:12.915618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:12.916659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 28 08:31:12.917532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:12.923472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 494/1001] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 28 08:31:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:12.923698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bea1c-aab9-4a53-9e6c-94cc2cca5842 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:12.935603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:13.041629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bea1c-aab9-4a53-9e6c-94cc2cca5842 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:13.078488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:13.079246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.079653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.080038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.080772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:13.081170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:13.082638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:13.088471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 508/1002] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:13.093730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:13.094392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:13.138992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:13.176777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:13.211497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169e0cf-0651-47e4-9b78-a4b6d89db2b0 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:13.251352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbccc-6c0d-48d1-a322-ac4178c214f4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:13.256718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:13.257463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.257998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.258363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.260050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:13.261544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:13.271455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:13.275756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:13.276676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 509/1003] 10.222.0.57 () {56 vars in 1105 bytes} [Wed Sep 28 08:31:13 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:13.278598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:13.300545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:13.301092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.301370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.301692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.302603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:13.302967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:13.304517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:13.315590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 495/1004] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 28 08:31:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:13.316490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:13.387849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e142ea-d1d4-4761-b686-838d2de267b9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:13.410061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:13.422356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e0668-38c9-44bd-a346-eb69fd79ca45 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:13.425305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:13.425305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.425305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.425637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.426002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] RBAC: Adding query filter params (name=image) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:13.426300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:13.427721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:13.429777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:13.438650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 510/1005] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:13.439879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:13.464301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5f1bb-f89d-4144-8c33-1d04c9c23e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:13.465248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f1bb-f89d-4144-8c33-1d04c9c23e06 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.465525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f1bb-f89d-4144-8c33-1d04c9c23e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.465798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f1bb-f89d-4144-8c33-1d04c9c23e06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.466497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5f1bb-f89d-4144-8c33-1d04c9c23e06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:13.468802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5f1bb-f89d-4144-8c33-1d04c9c23e06 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:13.562653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 496/1006] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:31:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:13.566536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aabef-7424-45a4-9fc2-592187a53454 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:13.609363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33fe8-250d-418f-8751-5823dcdbb072 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.609937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33fe8-250d-418f-8751-5823dcdbb072 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.610355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33fe8-250d-418f-8751-5823dcdbb072 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.612238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 497/1007] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:31:13.618892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcebe0-b044-45a3-ac09-96524dd575c8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.619169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcebe0-b044-45a3-ac09-96524dd575c8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.619507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebcebe0-b044-45a3-ac09-96524dd575c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.620104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:13.620836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:13.621221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:13.621600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:13.622423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] RBAC: Adding query filter params (type=image) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:13.622833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:13.624446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:13.640662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 511/1008] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:13.641957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6ebcebe0-b044-45a3-ac09-96524dd575c8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:13.643907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6ebcebe0-b044-45a3-ac09-96524dd575c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:13.736193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 498/1009] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:14.029197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:14.113257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:14.163446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa7b6-52cc-4ceb-a256-70981db67f77 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:14.207526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:14.207526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:14.207526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:14.207526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:14.207925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:14.211442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:14.219897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:14.220912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:14.221766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 512/1010] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:14.231468 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcebe0-b044-45a3-ac09-96524dd575c8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:14.335892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:14.343616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebcebe0-b044-45a3-ac09-96524dd575c8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:14.383533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:14.384474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:14.385141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:14.385511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:14.386252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:14.386656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:14.388627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:14.401814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:14.405442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 499/1011] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:31:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:14.508690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac6a5-c0e4-4f60-896c-e75e441ff105 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:14.534183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:14.547343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa2072-8db4-4a5c-bb25-181caa059e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:14.548187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2072-8db4-4a5c-bb25-181caa059e91 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:14.548560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2072-8db4-4a5c-bb25-181caa059e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:14.554073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2072-8db4-4a5c-bb25-181caa059e91 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:14.554073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa2072-8db4-4a5c-bb25-181caa059e91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:14.554073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa2072-8db4-4a5c-bb25-181caa059e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:14.554073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa2072-8db4-4a5c-bb25-181caa059e91 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:14.564093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 513/1012] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 28 08:31:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:14.565624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:14.693142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87df43a-8ca8-42e1-a7f6-d726a01677dc None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:14.729967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7645a-f543-4de8-8720-8a408a56c978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:14.730700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7645a-f543-4de8-8720-8a408a56c978 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:14.731074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7645a-f543-4de8-8720-8a408a56c978 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:14.731461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7645a-f543-4de8-8720-8a408a56c978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:14.732223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7645a-f543-4de8-8720-8a408a56c978 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:14.733680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7645a-f543-4de8-8720-8a408a56c978 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:14.825312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:14.839504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 500/1013] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:31:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:15.846526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43edc-db94-43a8-a935-9f803114525f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:15.847054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43edc-db94-43a8-a935-9f803114525f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:15.847054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43edc-db94-43a8-a935-9f803114525f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:15.848592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 514/1014] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:15.854491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2048f2c-3bbc-4813-a981-dc628b63ef0e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:15.854919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2048f2c-3bbc-4813-a981-dc628b63ef0e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:15.855087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2048f2c-3bbc-4813-a981-dc628b63ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:15.873806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d2048f2c-3bbc-4813-a981-dc628b63ef0e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:15.874983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d2048f2c-3bbc-4813-a981-dc628b63ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:15.881306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee486-d4f9-44dc-b878-0f4c656a0f27 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:15.881306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee486-d4f9-44dc-b878-0f4c656a0f27 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:15.881306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee486-d4f9-44dc-b878-0f4c656a0f27 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:15.881306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 515/1015] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:31:15.887490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc005-500b-4ef6-96e0-5e2584600181 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:15.887850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc005-500b-4ef6-96e0-5e2584600181 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:15.888188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc005-500b-4ef6-96e0-5e2584600181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:15.906348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-450bc005-500b-4ef6-96e0-5e2584600181 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:15.907665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-450bc005-500b-4ef6-96e0-5e2584600181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:15.958089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 501/1016] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:15 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:15.982874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 516/1017] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:15 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:16.235758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2048f2c-3bbc-4813-a981-dc628b63ef0e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:16.253044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc005-500b-4ef6-96e0-5e2584600181 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:16.341709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2048f2c-3bbc-4813-a981-dc628b63ef0e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:16.364023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc005-500b-4ef6-96e0-5e2584600181 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:16.365755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:16.376737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492cc1-2380-491c-a651-12e07880102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:16.385033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492cc1-2380-491c-a651-12e07880102c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:16.385033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492cc1-2380-491c-a651-12e07880102c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:16.385033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492cc1-2380-491c-a651-12e07880102c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:16.385033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61492cc1-2380-491c-a651-12e07880102c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:16.385033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61492cc1-2380-491c-a651-12e07880102c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:16.385033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 502/1018] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:16.386181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:16.390514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492cc1-2380-491c-a651-12e07880102c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:16.406033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4ceef-81f1-4d46-a34b-4db819d28c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:16.406647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ceef-81f1-4d46-a34b-4db819d28c51 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:16.406923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ceef-81f1-4d46-a34b-4db819d28c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:16.407196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ceef-81f1-4d46-a34b-4db819d28c51 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:16.407901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4ceef-81f1-4d46-a34b-4db819d28c51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:16.410308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4ceef-81f1-4d46-a34b-4db819d28c51 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:16.508432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492cc1-2380-491c-a651-12e07880102c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:16.512439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 517/1019] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:31:16 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:31:16.569391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efc7f1-4822-43f7-b1b8-c4f04953b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:16.570314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc7f1-4822-43f7-b1b8-c4f04953b763 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:16.570771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc7f1-4822-43f7-b1b8-c4f04953b763 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:16.572524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc7f1-4822-43f7-b1b8-c4f04953b763 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:16.573481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efc7f1-4822-43f7-b1b8-c4f04953b763 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:16.575255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efc7f1-4822-43f7-b1b8-c4f04953b763 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:16.705173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 503/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:31:16 2022] POST /identity/v3/projects => generated 311 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:31:17.339320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fad1b-2ca5-4641-a73e-aa866b9a2edb None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:17.339893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fad1b-2ca5-4641-a73e-aa866b9a2edb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:17.339893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fad1b-2ca5-4641-a73e-aa866b9a2edb None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:17.341252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 518/1021] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:17.346832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f087e-78af-4ae1-90a7-91e8d6f153be None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:17.347244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f087e-78af-4ae1-90a7-91e8d6f153be None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:17.347457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f087e-78af-4ae1-90a7-91e8d6f153be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:17.366973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ff4f087e-78af-4ae1-90a7-91e8d6f153be None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:17.368259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ff4f087e-78af-4ae1-90a7-91e8d6f153be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:17.404343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:17.436194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 504/1022] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:17.707523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fad1b-2ca5-4641-a73e-aa866b9a2edb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:17.809386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fad1b-2ca5-4641-a73e-aa866b9a2edb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:17.842938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:17.843594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:17.843871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:17.844137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:17.854233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:17.858979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:17.860108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:17.861004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 519/1023] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 28 08:31:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:17.866122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f087e-78af-4ae1-90a7-91e8d6f153be None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:17.977810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f087e-78af-4ae1-90a7-91e8d6f153be None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:18.012977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:18.013612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.013896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.014169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.014829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:18.015134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:18.016523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:18.025374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 505/1024] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 28 08:31:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:18.031119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:18.073242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:18.133989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8f772-e41f-41bd-b7e1-f85f89f36c36 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:18.169187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:18.169857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.170137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.170407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.183473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:18.184910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:18.199869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:18.200836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:18.206339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:18.206339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:18.206339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:18.206339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 520/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:18.208408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:18.241787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:18.313082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c591d-a7c6-4183-9229-295181dd82a3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:18.347563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:18.348172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.348439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.348714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.349353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:18.349657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:18.351068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:18.367078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 506/1026] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:18.369267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:18.462697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:18.472970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d70f7b-10d0-400b-8e5e-260af6f5e5ab None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:18.510306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:18.510306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.510306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.510306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.517649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:18.519087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:31:18.530512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:18.531746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:31:18.532748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:18.535551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 521/1027] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:31:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:18.537675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:18.634751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:18.644929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a1645-2d53-4a7e-b71a-c52204470643 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:18.681625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975af90-868f-480d-979e-03257b9ac99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:18.682277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975af90-868f-480d-979e-03257b9ac99c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.682563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975af90-868f-480d-979e-03257b9ac99c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.682860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975af90-868f-480d-979e-03257b9ac99c None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.683616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975af90-868f-480d-979e-03257b9ac99c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:18.683929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975af90-868f-480d-979e-03257b9ac99c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:18.685402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975af90-868f-480d-979e-03257b9ac99c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:18.707313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 507/1028] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:31:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:18.709025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:18.742655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336d05-8037-4030-bf3f-4363927a05c8 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.743072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336d05-8037-4030-bf3f-4363927a05c8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.743342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30336d05-8037-4030-bf3f-4363927a05c8 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.744776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 508/1029] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:18.749453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565dee-c5b9-4ed0-8a09-4c6f7a1f309e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.752006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565dee-c5b9-4ed0-8a09-4c6f7a1f309e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.752006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565dee-c5b9-4ed0-8a09-4c6f7a1f309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.768574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-43565dee-c5b9-4ed0-8a09-4c6f7a1f309e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:18.769682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-43565dee-c5b9-4ed0-8a09-4c6f7a1f309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:18.823489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100c9e-83c3-4c56-be08-733767d6f446 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:18.844650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 509/1030] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:18.864007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:18.864642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.864927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.865205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.890293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:18.947480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:18.948945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:18.987875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af05c-f936-4fb1-8ca6-851c41c06528 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.988213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af05c-f936-4fb1-8ca6-851c41c06528 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.988431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af05c-f936-4fb1-8ca6-851c41c06528 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:18.989976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 510/1031] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:31:18.995004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d1e9-da3d-4eec-b8f5-360c28a884bc None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:18.995197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d1e9-da3d-4eec-b8f5-360c28a884bc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:18.995488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d1e9-da3d-4eec-b8f5-360c28a884bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.013951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3863d1e9-da3d-4eec-b8f5-360c28a884bc None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:19.015111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3863d1e9-da3d-4eec-b8f5-360c28a884bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:19.055986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 522/1032] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:19.061573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.099522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 511/1033] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:19.111957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.113493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d1e9-da3d-4eec-b8f5-360c28a884bc None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.126258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.164329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f4b38-9d6c-457a-b4ae-125c0826babb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.198981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.199641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.199907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.200184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.212319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.214336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.219694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d1e9-da3d-4eec-b8f5-360c28a884bc None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:19.229677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:19.230692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:19.231740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:19.231740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:19.231740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:19.231740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 523/1034] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:19.236345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.259732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.260413 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.260674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.260942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.261521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.262857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:19.272159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:19.273205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:19.274605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 512/1035] 10.222.0.57 () {56 vars in 1105 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:19.279759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.346124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f272d9b-e7e1-4047-bd04-7606a2452d29 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.347602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.361932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.379798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.380510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.380672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.380945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.381585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:19.381887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.383282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.388187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cc66a-b168-4572-a382-c1282bed6fd8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.395401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 524/1036] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:19.397717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.423675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.424284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.424567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.424851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.425475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] RBAC: Adding query filter params (name=image) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:19.425788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.427141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.432064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 513/1037] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:19.432845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.493557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a07022-fced-4d26-a2b3-9dfa7063fc1d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.527642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.528268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.528549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.528820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.529922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.531341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.532166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbd050-b48b-447a-8334-a16bbf333a80 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.532928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 525/1038] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:19.533684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.562771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.565560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.566195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.566480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.566756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.574099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.575557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.577280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:31:19.587860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:19.588931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:19.589885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 514/1039] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:19.590381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.633946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924cca8-6042-4240-8325-50cad028f4b3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.667167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.667798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.668075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.668342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.668959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] RBAC: Adding query filter params (type=image) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:19.669254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.670599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.675173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 526/1040] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:19.675986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.692021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a68b-aeb6-414e-8075-ae5d3c76e902 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.726515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.727216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.727524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.727920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.728575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.729987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.767269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.773719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f0ef-66c8-4ece-9bbf-2cfec1a6d45d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.806422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.807017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.807295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.807598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.808281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:19.808582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.810111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.821156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 515/1041] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:31:19 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:19.826576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.826850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 527/1042] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:19.827871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:19.897886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:19.945150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122dc5b-5043-4246-99c2-283ec1355f3a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.954102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eab5e-acd5-489b-99e7-68945001384d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:19.985343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.986058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.986421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.986756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:19.987616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] RBAC: Adding query filter params (role.id=e0779a37914d4626abe920666b1b7f2d, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=0969ec55ae1244c09694079a72bf8310) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:19.987985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:19.989493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:19.995188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ddb8-a221-427a-bcf6-27fa0e2f0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:19.995851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ddb8-a221-427a-bcf6-27fa0e2f0e70 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:19.996131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ddb8-a221-427a-bcf6-27fa0e2f0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:19.996410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ddb8-a221-427a-bcf6-27fa0e2f0e70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:20.003503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 528/1043] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/role_assignments?user.id=0969ec55ae1244c09694079a72bf8310&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=e0779a37914d4626abe920666b1b7f2d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:20.003722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ddb8-a221-427a-bcf6-27fa0e2f0e70 None admin] RBAC: Adding query filter params (interface=public, service_id=140c67b77e4741d9adf4545a5de7dd8f, region_id=RegionOne) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:20.003722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ddb8-a221-427a-bcf6-27fa0e2f0e70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:20.003722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ddb8-a221-427a-bcf6-27fa0e2f0e70 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:20.008958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 516/1044] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:31:19 2022] GET /identity/v3/endpoints?service_id=140c67b77e4741d9adf4545a5de7dd8f&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:20.015936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:20.040862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:20.131290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020f03c-7df7-4e99-b31d-c8e5a3abdd85 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:20.174191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470ddbb-9c21-471c-bae8-610819ca841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:20.174715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ddbb-9c21-471c-bae8-610819ca841b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:20.174994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ddbb-9c21-471c-bae8-610819ca841b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:20.175264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470ddbb-9c21-471c-bae8-610819ca841b None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:20.175905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470ddbb-9c21-471c-bae8-610819ca841b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:20.177264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470ddbb-9c21-471c-bae8-610819ca841b None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:20.184518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 529/1045] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:31:20 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:31:22.114509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc4e93-0f35-4dfd-97e0-4400e05a1e22 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.115081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc4e93-0f35-4dfd-97e0-4400e05a1e22 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.115081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc4e93-0f35-4dfd-97e0-4400e05a1e22 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.116651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 517/1046] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:22.122426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06c1f6-0f51-4b31-8f53-7bb98dcfe561 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.123217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06c1f6-0f51-4b31-8f53-7bb98dcfe561 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.123738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06c1f6-0f51-4b31-8f53-7bb98dcfe561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.142627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1b06c1f6-0f51-4b31-8f53-7bb98dcfe561 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:22.144131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1b06c1f6-0f51-4b31-8f53-7bb98dcfe561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:22.186800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185dca-d1ab-4d9c-a088-168bb3d6c8ca None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.186987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185dca-d1ab-4d9c-a088-168bb3d6c8ca None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.187256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185dca-d1ab-4d9c-a088-168bb3d6c8ca None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.188629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 518/1047] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:22.193340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2156b-ad56-4352-860a-edbc3f229b1a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.193621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2156b-ad56-4352-860a-edbc3f229b1a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.193894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2156b-ad56-4352-860a-edbc3f229b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.212868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1dc2156b-ad56-4352-860a-edbc3f229b1a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:22.214043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1dc2156b-ad56-4352-860a-edbc3f229b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:22.215658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 530/1048] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:22.286616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 519/1049] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:22.371794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29455-beeb-47bf-9e52-cf9a989293a8 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.372138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29455-beeb-47bf-9e52-cf9a989293a8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.372360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29455-beeb-47bf-9e52-cf9a989293a8 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.373875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 531/1050] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:22.378833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50160f-58ff-457f-8a33-7551fddf0d27 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.379127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50160f-58ff-457f-8a33-7551fddf0d27 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.379406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50160f-58ff-457f-8a33-7551fddf0d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.397754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9b50160f-58ff-457f-8a33-7551fddf0d27 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:22.399799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9b50160f-58ff-457f-8a33-7551fddf0d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:22.443174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:22.468804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 520/1051] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:22.487211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29455-beeb-47bf-9e52-cf9a989293a8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:22.504614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:22.562714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50160f-58ff-457f-8a33-7551fddf0d27 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:22.593772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29455-beeb-47bf-9e52-cf9a989293a8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:22.632070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:22.632815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.633120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.633972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.645098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:22.650874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:22.651939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:22.652904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 532/1052] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:22.657713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:22.666837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50160f-58ff-457f-8a33-7551fddf0d27 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:22.705553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:22.706111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.706393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.706680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.717977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:22.722859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:22.724007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:22.728267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 521/1053] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 28 08:31:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:22.731400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:22.743496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:22.775268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661fd8-3193-4842-9ad5-376b00b2a91b None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:22.786588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:22.809257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:22.809842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.810123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.810433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.811096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:22.811396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:22.812785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:22.822701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 533/1054] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:22.822701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:22.845897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fec94-0050-457a-8001-648589e99ab7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:22.879605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:22.880206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.880482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.880762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.881420 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:22.881723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:22.883721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:22.891912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 522/1055] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 28 08:31:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:22.895688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:22.929335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4033-086e-48d7-9222-2e5f69fc7401 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:22.964186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:22.964186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:22.964186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:22.964186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] PATH_INFO: `/v3/services/image` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:22.964718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:22.966084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:22.967868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:22.975299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:22.976521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:22.977760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 534/1056] 10.222.0.57 () {56 vars in 1105 bytes} [Wed Sep 28 08:31:22 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:22.978617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:22.993114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:22.996310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc47c-61c7-407f-8935-1828b9ee536c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.030031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.030666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.031035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.031215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] PATH_INFO: `/v3/users/3ef585b3f8bb477198fb34e13c25fe22` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.044551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] RBAC: Authorizing `identity:get_user(user_id=3ef585b3f8bb477198fb34e13c25fe22)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.045979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.047620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 523/1057] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:22 2022] GET /identity/v3/users/3ef585b3f8bb477198fb34e13c25fe22 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:23.048396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.080799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf77910-eddd-4fc0-a5fd-2d3bdc205755 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.115236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.115890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.116169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.116440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.126584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.128065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:23.143021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:23.144101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:23.145103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:23.145103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:23.145103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:23.145103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 535/1058] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:23.145103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.151533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2655f7-be58-4569-a1b5-d2635a5c12fd None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.186588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.189389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.189389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.189389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.189389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] RBAC: Adding query filter params (name=image) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:23.189389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.190135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.194624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.194849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 524/1059] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:23.195697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.219870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.249694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb80cf-9732-4ca4-a5cf-70fa1c72066d None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.282777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.283372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.283735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.284015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.296250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942f2b-311f-4ed0-b3e3-67d680551b16 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.332094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.332754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.333070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.333344 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.333989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:23.334293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.335675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.347170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 525/1060] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:23.347994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.350948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.353116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.400846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.431960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.449501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc72fc-e1ef-4150-8977-4cb1c1f96340 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.450729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 536/1061] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:23.451586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.483895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.484429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.484709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.484983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.485610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] RBAC: Adding query filter params (type=image) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:23.485912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.487258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.492203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 526/1062] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:23.493673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.553784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16ee5b-7d1f-4725-a74f-484e8913bfc1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.587397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.588039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.588320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.588592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.592308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a988fdf-2c63-4919-ac3e-3fe99cc98c7c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.595504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.596932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:31:23.608250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:23.609253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 537/1063] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:23.610250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.624458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.628552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.629183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.629461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.629731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.630836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] RBAC: Authorizing `identity:get_project(project_id=24fa245953b04b2a96af40db57c95867)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.632356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.634968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 527/1064] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/projects/24fa245953b04b2a96af40db57c95867 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:23.640069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.651767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.715814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c102632-44bc-40f6-b66b-3034a020cd0f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.734252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8c3d-0447-41d6-ba6e-f0f1c7123a16 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.748917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.749596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.749883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.750155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.750813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.752238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.768557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.769153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.769429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.769698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.770410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:23.770711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.772132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.788700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 528/1065] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:23.789552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.825178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 538/1066] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:31:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:23.825996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:23.859087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.895664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc849d-721e-4adb-90fa-e664bb981ea2 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.912684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:23.949590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:23.950209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:23.950485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:23.950753 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:23.951526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=24fa245953b04b2a96af40db57c95867, user.id=3ef585b3f8bb477198fb34e13c25fe22) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:23.951836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:23.953285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:23.962001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3c892-b237-43b2-b842-18b8df8ee0b2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:23.962225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 529/1067] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/role_assignments?user.id=3ef585b3f8bb477198fb34e13c25fe22&scope.project.id=24fa245953b04b2a96af40db57c95867&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:23.999049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:24.000259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:24.000259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:24.000259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:24.013730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:24.015586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:24.032603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:24.033858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:24.034975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:24.034975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:24.034975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:24.036465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 539/1068] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:24.042701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:24.153864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450db0-1d6b-492e-a5c4-59a693e9cb68 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:24.188679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:24.193955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:24.194605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:24.194890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:24.195168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:24.196315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:24.196315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:24.197689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:24.209976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 530/1069] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:24.215677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:24.319061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ebb13-9b06-4c74-bef5-ce9c8b96325f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:24.340190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:24.358440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963731-c705-4e88-8784-022825159c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:24.359067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963731-c705-4e88-8784-022825159c8f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:24.359343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963731-c705-4e88-8784-022825159c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:24.359639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963731-c705-4e88-8784-022825159c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:24.366174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963731-c705-4e88-8784-022825159c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:24.368288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963731-c705-4e88-8784-022825159c8f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-d6963731-c705-4e88-8784-022825159c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:31:24.380008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:24.380931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:24.381885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:24.382965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 540/1070] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:24.387866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:24.497055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3725ae2-61a1-4afa-8434-5f6cd33bd3f9 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:24.532594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85313b08-09ed-4e35-b4c8-7c92a5c0a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:24.533532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85313b08-09ed-4e35-b4c8-7c92a5c0a17d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:24.533993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85313b08-09ed-4e35-b4c8-7c92a5c0a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:24.534460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85313b08-09ed-4e35-b4c8-7c92a5c0a17d None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:24.535378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85313b08-09ed-4e35-b4c8-7c92a5c0a17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:24.535950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85313b08-09ed-4e35-b4c8-7c92a5c0a17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:24.537622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85313b08-09ed-4e35-b4c8-7c92a5c0a17d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:24.554279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 531/1071] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:24.556148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963731-c705-4e88-8784-022825159c8f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:24.659350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963731-c705-4e88-8784-022825159c8f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:24.694381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aab58-27c2-49a9-b580-b3251df9f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:24.695361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aab58-27c2-49a9-b580-b3251df9f557 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:24.695893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aab58-27c2-49a9-b580-b3251df9f557 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:24.696315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aab58-27c2-49a9-b580-b3251df9f557 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/0969ec55ae1244c09694079a72bf8310/roles/e0779a37914d4626abe920666b1b7f2d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:24.698658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081aab58-27c2-49a9-b580-b3251df9f557 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=0969ec55ae1244c09694079a72bf8310, role_id=e0779a37914d4626abe920666b1b7f2d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:24.700254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081aab58-27c2-49a9-b580-b3251df9f557 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:24.776437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 541/1072] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:31:24 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/0969ec55ae1244c09694079a72bf8310/roles/e0779a37914d4626abe920666b1b7f2d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:31:26.051361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d085-8658-49d9-92b5-ae3f1071d983 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.051926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d085-8658-49d9-92b5-ae3f1071d983 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.051926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d085-8658-49d9-92b5-ae3f1071d983 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.053421 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 532/1073] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:26.059138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2c76-a364-480b-bc2b-dd8a8587c001 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.059599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2c76-a364-480b-bc2b-dd8a8587c001 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.059752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2c76-a364-480b-bc2b-dd8a8587c001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.081297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9a3d2c76-a364-480b-bc2b-dd8a8587c001 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:26.082523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9a3d2c76-a364-480b-bc2b-dd8a8587c001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:26.109785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4704f3-df1d-47bb-a1cf-8b0f96575a1f None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.110003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4704f3-df1d-47bb-a1cf-8b0f96575a1f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.110264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4704f3-df1d-47bb-a1cf-8b0f96575a1f None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.112312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 533/1074] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:26.115111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:26.119939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e73371-b835-4fdd-aa23-95865eeba5b7 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.120441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e73371-b835-4fdd-aa23-95865eeba5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.120890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e73371-b835-4fdd-aa23-95865eeba5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.141458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a3e73371-b835-4fdd-aa23-95865eeba5b7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:26.142940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a3e73371-b835-4fdd-aa23-95865eeba5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:26.158649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 542/1075] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:26.205278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:26.230394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 534/1076] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:31:26.425118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2c76-a364-480b-bc2b-dd8a8587c001 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:26.510525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e73371-b835-4fdd-aa23-95865eeba5b7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:26.532338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2c76-a364-480b-bc2b-dd8a8587c001 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:26.569172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:26.569778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.570060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.570373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.608222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:26.613465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e73371-b835-4fdd-aa23-95865eeba5b7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:26.642152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:26.643740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:26.650230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:26.650897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.651180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.651526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.663111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:26.669851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:26.670836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:26.671728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:26.673134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 535/1077] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:26.677734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:26.721996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:26.752635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 543/1078] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:26.758625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:26.783293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f5fff-ad93-4367-9f89-c61fd831f6ba None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:26.821733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:26.822336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.822613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.822879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.823565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:26.823868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:26.825297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:26.832728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:26.833705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 536/1079] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:26.839698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:26.874155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1fe4-7da8-4405-86ef-7d7cde4f2bf3 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:26.913120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:26.913910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:26.915027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:26.915375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:26.929150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:26.930660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:26.945500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:26.946511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:26.947474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:26.947474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:26.947474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:26.947474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 544/1080] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:26.952552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:26.963620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0dc27-5e0b-400d-9f75-14a978306fe6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:26.966718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:27.000778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:27.001420 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.001710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.002026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] PATH_INFO: `/v3/users/3ef585b3f8bb477198fb34e13c25fe22` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.003394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=3ef585b3f8bb477198fb34e13c25fe22)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:27.005317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:27.012477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 537/1081] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:26 2022] GET /identity/v3/users/3ef585b3f8bb477198fb34e13c25fe22 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:27.013610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:27.058984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623426f2-b759-418f-a63c-4b775ce4c3f5 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:27.077784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:27.094018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d16f65-ea61-4317-981e-1a2aad7e0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:27.094622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d16f65-ea61-4317-981e-1a2aad7e0812 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.094900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d16f65-ea61-4317-981e-1a2aad7e0812 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.095171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d16f65-ea61-4317-981e-1a2aad7e0812 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.095871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d16f65-ea61-4317-981e-1a2aad7e0812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:27.096175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d16f65-ea61-4317-981e-1a2aad7e0812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:27.097562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d16f65-ea61-4317-981e-1a2aad7e0812 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:27.109904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 545/1082] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:27.111229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734f6c-a7e5-4d3f-a265-519162237ddf None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.111557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734f6c-a7e5-4d3f-a265-519162237ddf None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.111833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734f6c-a7e5-4d3f-a265-519162237ddf None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.111935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6b552-6909-41a5-a232-46c913583cf7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:27.115753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 546/1083] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:27.119546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9408-3226-4a27-973f-ee90dd8bbc3d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.119827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9408-3226-4a27-973f-ee90dd8bbc3d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.120098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9408-3226-4a27-973f-ee90dd8bbc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.139811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-361c9408-3226-4a27-973f-ee90dd8bbc3d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:27.141051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-361c9408-3226-4a27-973f-ee90dd8bbc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:27.174786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:27.175904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.176187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.176467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.177736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] RBAC: Authorizing `identity:get_project(project_id=24fa245953b04b2a96af40db57c95867)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:27.179189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:27.187460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 538/1084] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:27 2022] GET /identity/v3/projects/24fa245953b04b2a96af40db57c95867 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:27.188232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:27.219737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 547/1085] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:27.238137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:27.305829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863fb55-25b9-4998-820a-72363bfc07b3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:27.342325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:27.343269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.343727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.344154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867/users/3ef585b3f8bb477198fb34e13c25fe22/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.346052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] RBAC: Authorizing `identity:create_grant(project_id=24fa245953b04b2a96af40db57c95867, user_id=3ef585b3f8bb477198fb34e13c25fe22, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:27.347503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:27.415269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 539/1086] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:31:27 2022] PUT /identity/v3/projects/24fa245953b04b2a96af40db57c95867/users/3ef585b3f8bb477198fb34e13c25fe22/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:31:27.489965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9408-3226-4a27-973f-ee90dd8bbc3d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:27.602681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9408-3226-4a27-973f-ee90dd8bbc3d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:27.613432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:27.637362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:27.637986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.638259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.638527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.648669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:27.653447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:27.654470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:27.655450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 548/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 28 08:31:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:27.660426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:27.754453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:27.757750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fb57-d0cd-4172-a047-9ae0d1bd4f71 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:27.792301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:27.792907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.793184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.793451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.794108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:27.794405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:27.795786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:27.804068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 540/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 28 08:31:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:27.811815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:27.912114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e851a5-c8ff-42e9-b82e-2e74eb22ea87 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:27.948938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:27.949555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:27.949829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:27.950096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:27.959738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:27.961336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:27.975376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:27.976369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:27.978120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:27.978120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:27.978120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:27.978120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 549/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:27.982668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:28.077626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33952b2f-59d8-46ea-b194-cf84372d539c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:28.109809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:28.110414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:28.110691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:28.110960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:28.111886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:28.112189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:28.113538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:28.126704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 541/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:28.132643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:28.158271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:28.232906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b25191-5052-4695-8723-d2f460642657 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:28.267210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:28.267859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:28.268133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:28.268401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:28.275825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:28.277248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:31:28.289573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:28.290666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:28.291683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 550/1091] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 28 08:31:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:28.296947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:28.321576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:28.393979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366967da-bd4c-467f-8b5d-3e0200a1e9ed None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:28.428075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:28.428672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:28.428948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:28.429218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:28.430477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:28.430779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:28.432208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:28.453838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 542/1092] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 28 08:31:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:28.455020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:28.535014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:28.552912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52756f2d-f254-484f-8043-a133ddc957a7 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:28.587108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:28.587754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:28.588037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:28.588309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:28.658553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:28.660039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:28.738492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:28.757204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 551/1093] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:28.763367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:28.841411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:28.859707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570bf79-3d0b-4e08-bc36-9c5aa7ba8479 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:28.893707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:28.894325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:28.894605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:28.894876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:28.905017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:28.906429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:31:28.922791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:28.924028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:31:28.924944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:31:28.924944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:31:28.924944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:28.927570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 543/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:28.929583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:29.027248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a08c6-f13b-400c-9426-abde816bef77 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:29.060007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:29.060700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:29.060981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:29.061245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:29.061873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:29.062171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:29.063552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:29.075190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 552/1095] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:29.080812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:29.175470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aed9d-7f2d-461d-b334-38edcb8274d5 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:29.203555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:29.208685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:29.209310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:29.209586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:29.209851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:29.216481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:29.217896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:31:29.229129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:29.230242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:29.231158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 544/1096] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:29.236130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:29.278447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:29.333730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e00a48-d923-4d8e-9f40-bb4c41bf4a89 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:29.366193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d80e1-b9c6-4ed4-9766-28b2a099faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:29.366786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d80e1-b9c6-4ed4-9766-28b2a099faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:29.367063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d80e1-b9c6-4ed4-9766-28b2a099faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:29.367956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d80e1-b9c6-4ed4-9766-28b2a099faf7 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:29.368609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d80e1-b9c6-4ed4-9766-28b2a099faf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:29.368908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d80e1-b9c6-4ed4-9766-28b2a099faf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:29.370319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d80e1-b9c6-4ed4-9766-28b2a099faf7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:29.381830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 553/1097] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:31:29.388322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:29.495188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb3b96-2611-494a-9758-9a82aad197fc None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:29.529104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d676510-ebb9-420f-8774-0bc21b321996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:29.529696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d676510-ebb9-420f-8774-0bc21b321996 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:29.529977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d676510-ebb9-420f-8774-0bc21b321996 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:29.530251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d676510-ebb9-420f-8774-0bc21b321996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:29.530968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d676510-ebb9-420f-8774-0bc21b321996 None admin] RBAC: Adding query filter params (role.id=e0779a37914d4626abe920666b1b7f2d, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=0969ec55ae1244c09694079a72bf8310) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:29.531275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d676510-ebb9-420f-8774-0bc21b321996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:29.532716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d676510-ebb9-420f-8774-0bc21b321996 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:29.538544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 545/1098] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:29 2022] GET /identity/v3/role_assignments?user.id=0969ec55ae1244c09694079a72bf8310&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=e0779a37914d4626abe920666b1b7f2d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:29.575911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f669-d5bb-4e68-bf4f-fa0fb5b1feaa None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:29.576197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f669-d5bb-4e68-bf4f-fa0fb5b1feaa None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:29.576472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2f669-d5bb-4e68-bf4f-fa0fb5b1feaa None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:29.577825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 554/1099] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:29.583728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa13cf-c3ca-4dab-bb2a-3dd96f377f93 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:29.584009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa13cf-c3ca-4dab-bb2a-3dd96f377f93 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:29.584282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa13cf-c3ca-4dab-bb2a-3dd96f377f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:29.604226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-e1aa13cf-c3ca-4dab-bb2a-3dd96f377f93 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:29.605434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e1aa13cf-c3ca-4dab-bb2a-3dd96f377f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:29.661163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:29.679331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 546/1100] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:29.950061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2f669-d5bb-4e68-bf4f-fa0fb5b1feaa None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:30.054260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2f669-d5bb-4e68-bf4f-fa0fb5b1feaa None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:30.056623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:30.090059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:30.090687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:30.090967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:30.091239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:30.101986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:30.106740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:30.107858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:30.108739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 555/1101] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:31:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:30.114018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa13cf-c3ca-4dab-bb2a-3dd96f377f93 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:30.216837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa13cf-c3ca-4dab-bb2a-3dd96f377f93 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:30.251252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:30.252041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:30.252325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:30.252593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:30.253255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:30.253558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:30.254908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:30.264113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 547/1102] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:30.270193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:30.373866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23258431-8cea-4f98-b1e8-3224806f13e7 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:30.411198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:30.411858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:30.412139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:30.412420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] PATH_INFO: `/v3/users/3ef585b3f8bb477198fb34e13c25fe22` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:30.413545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] RBAC: Authorizing `identity:get_user(user_id=3ef585b3f8bb477198fb34e13c25fe22)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:30.415042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:30.416654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 556/1103] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:30 2022] GET /identity/v3/users/3ef585b3f8bb477198fb34e13c25fe22 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:30.422511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:30.477952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:30.527780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb2f9-a38f-4623-aba9-959d10a08fcb None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:30.560492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:30.561083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:30.561362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:30.561634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:30.624707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:30.626117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:30.671286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:30.723360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 548/1104] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:30.729340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:30.760410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:30.828033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108844b1-4e70-4c4b-bb02-4500b30381ff None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:30.861589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd3379-1b96-4f4f-8468-618f083af110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:30.862192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd3379-1b96-4f4f-8468-618f083af110 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:30.862465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd3379-1b96-4f4f-8468-618f083af110 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:30.862738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd3379-1b96-4f4f-8468-618f083af110 None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:30.863843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd3379-1b96-4f4f-8468-618f083af110 None admin] RBAC: Authorizing `identity:get_project(project_id=24fa245953b04b2a96af40db57c95867)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:30.865253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd3379-1b96-4f4f-8468-618f083af110 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:30.866822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 557/1105] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:30 2022] GET /identity/v3/projects/24fa245953b04b2a96af40db57c95867 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:30.873610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:30.973814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07de87-87bd-456f-8d80-007f187b50eb None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:31.006836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c6082-fcdb-4e07-84de-754377e205c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:31.007446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c6082-fcdb-4e07-84de-754377e205c2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:31.007766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c6082-fcdb-4e07-84de-754377e205c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:31.008034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c6082-fcdb-4e07-84de-754377e205c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:31.008740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c6082-fcdb-4e07-84de-754377e205c2 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=24fa245953b04b2a96af40db57c95867, user.id=3ef585b3f8bb477198fb34e13c25fe22) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:31.009298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c6082-fcdb-4e07-84de-754377e205c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:31.010726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c6082-fcdb-4e07-84de-754377e205c2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:31.016250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 549/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:30 2022] GET /identity/v3/role_assignments?user.id=3ef585b3f8bb477198fb34e13c25fe22&scope.project.id=24fa245953b04b2a96af40db57c95867&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:33.163205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7ffa-d623-4c78-b924-b0cb636f43f1 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:33.164493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7ffa-d623-4c78-b924-b0cb636f43f1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:33.164493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb7ffa-d623-4c78-b924-b0cb636f43f1 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:33.165657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 558/1107] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:33.171051 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55ab9-168a-422d-adea-540bea29f2fd None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:33.171480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55ab9-168a-422d-adea-540bea29f2fd None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:33.171630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55ab9-168a-422d-adea-540bea29f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:33.190380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3ae55ab9-168a-422d-adea-540bea29f2fd None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:33.191541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3ae55ab9-168a-422d-adea-540bea29f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:33.199168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:33.256945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 550/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:33.522293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7ffa-d623-4c78-b924-b0cb636f43f1 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:33.614898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:33.619352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb7ffa-d623-4c78-b924-b0cb636f43f1 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:33.652090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff257-70ee-4839-a456-9c19bbcb3aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:33.652719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff257-70ee-4839-a456-9c19bbcb3aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:33.652993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff257-70ee-4839-a456-9c19bbcb3aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:33.653263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff257-70ee-4839-a456-9c19bbcb3aa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:33.654349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ff257-70ee-4839-a456-9c19bbcb3aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:33.655891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ff257-70ee-4839-a456-9c19bbcb3aa9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:33.657431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 559/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:33.663055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55ab9-168a-422d-adea-540bea29f2fd None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:33.757207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55ab9-168a-422d-adea-540bea29f2fd None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:33.791192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcea1f-69c6-47eb-8885-dd8fbf1a52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:33.791755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcea1f-69c6-47eb-8885-dd8fbf1a52e1 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:33.792031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcea1f-69c6-47eb-8885-dd8fbf1a52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:33.792301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcea1f-69c6-47eb-8885-dd8fbf1a52e1 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:33.792957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcea1f-69c6-47eb-8885-dd8fbf1a52e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:33.794354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcea1f-69c6-47eb-8885-dd8fbf1a52e1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:33.897830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:33.903509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 551/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:31:33 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:36.083140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ccf5c-fde2-47f6-b5ef-18ebb0198c09 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:36.083679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ccf5c-fde2-47f6-b5ef-18ebb0198c09 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:36.083792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ccf5c-fde2-47f6-b5ef-18ebb0198c09 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:36.085032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 560/1111] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:36.090710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc7d7-83cc-4ad4-b61a-361cd31f6b68 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:36.091140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc7d7-83cc-4ad4-b61a-361cd31f6b68 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:36.091232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc7d7-83cc-4ad4-b61a-361cd31f6b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:36.109130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5a6bc7d7-83cc-4ad4-b61a-361cd31f6b68 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:36.110298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5a6bc7d7-83cc-4ad4-b61a-361cd31f6b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:36.174724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 552/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:36.441186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ccf5c-fde2-47f6-b5ef-18ebb0198c09 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:36.544363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ccf5c-fde2-47f6-b5ef-18ebb0198c09 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:36.578900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:36.579544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:36.579827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:36.580102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] PATH_INFO: `/v3/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:36.581477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] RBAC: Authorizing `identity:get_role(role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:36.582841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:36.584173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 561/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:36 2022] GET /identity/v3/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:36.589991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bc7d7-83cc-4ad4-b61a-361cd31f6b68 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:36.686310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bc7d7-83cc-4ad4-b61a-361cd31f6b68 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:36.711755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:36.719123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:36.719778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:36.726210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:36.726210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] PATH_INFO: `/v3/users/687a440df34c4a3583b6c78a012205cb` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:36.733037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] RBAC: Authorizing `identity:get_user(user_id=687a440df34c4a3583b6c78a012205cb)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:36.734462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:36.736066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 553/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:36 2022] GET /identity/v3/users/687a440df34c4a3583b6c78a012205cb => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:36.742259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:36.776337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:36.919841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1a429-b07f-4477-bb0c-744dc27b03b2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:36.953694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:36.954292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:36.954572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:36.954844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:37.019178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:37.020641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:37.051663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:37.114385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 562/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:37.121086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:37.216288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f286bf-f212-4d17-a798-6b55c869a07a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:37.249131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef745f3-b423-4816-89a6-428ff1ba2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:37.249746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef745f3-b423-4816-89a6-428ff1ba2b8c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:37.250027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef745f3-b423-4816-89a6-428ff1ba2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:37.250302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef745f3-b423-4816-89a6-428ff1ba2b8c None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:37.251393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef745f3-b423-4816-89a6-428ff1ba2b8c None admin] RBAC: Authorizing `identity:get_project(project_id=24fa245953b04b2a96af40db57c95867)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:37.252831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef745f3-b423-4816-89a6-428ff1ba2b8c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:37.254417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 554/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:37 2022] GET /identity/v3/projects/24fa245953b04b2a96af40db57c95867 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:37.261438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:37.357006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ebf8-2712-4a7d-9ee3-180b35ebca32 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:37.390325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a187692-add7-4de0-9939-55aff093e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:37.390914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187692-add7-4de0-9939-55aff093e53e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:37.391194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187692-add7-4de0-9939-55aff093e53e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:37.391486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a187692-add7-4de0-9939-55aff093e53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:37.392200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a187692-add7-4de0-9939-55aff093e53e None admin] RBAC: Adding query filter params (role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=24fa245953b04b2a96af40db57c95867, user.id=687a440df34c4a3583b6c78a012205cb) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:37.392506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a187692-add7-4de0-9939-55aff093e53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:37.393918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a187692-add7-4de0-9939-55aff093e53e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:37.395632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:37.399682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 563/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:37 2022] GET /identity/v3/role_assignments?user.id=687a440df34c4a3583b6c78a012205cb&scope.project.id=24fa245953b04b2a96af40db57c95867&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:39.511603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44798-c048-4082-a805-a298a6236524 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:39.512125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44798-c048-4082-a805-a298a6236524 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:39.512125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44798-c048-4082-a805-a298a6236524 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:39.513466 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 555/1118] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:39.518592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce0eed-7d03-4911-a3fe-4a39a271cc5e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:39.519007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce0eed-7d03-4911-a3fe-4a39a271cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:39.519145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce0eed-7d03-4911-a3fe-4a39a271cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:39.537520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-29ce0eed-7d03-4911-a3fe-4a39a271cc5e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:39.538927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-29ce0eed-7d03-4911-a3fe-4a39a271cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:39.603866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 564/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:39.875447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe44798-c048-4082-a805-a298a6236524 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:39.930660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:39.973835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe44798-c048-4082-a805-a298a6236524 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:40.006563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:40.007228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:40.007578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:40.007895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] PATH_INFO: `/v3/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:40.009532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] RBAC: Authorizing `identity:get_role(role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:40.010875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:40.012208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 556/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:39 2022] GET /identity/v3/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:40.017951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce0eed-7d03-4911-a3fe-4a39a271cc5e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:40.112768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce0eed-7d03-4911-a3fe-4a39a271cc5e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:40.138587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:40.145989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:40.146608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:40.146886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:40.147156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] PATH_INFO: `/v3/users/687a440df34c4a3583b6c78a012205cb` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:40.148829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] RBAC: Authorizing `identity:get_user(user_id=687a440df34c4a3583b6c78a012205cb)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:40.150238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:40.151809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 565/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:40 2022] GET /identity/v3/users/687a440df34c4a3583b6c78a012205cb => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:40.157597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:40.251549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa87e-1863-44fd-9639-e38b2023e630 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:40.272388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:40.283547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e546d0-cc90-46ef-83e5-60a26c0b6ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:40.284161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e546d0-cc90-46ef-83e5-60a26c0b6ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:40.284438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e546d0-cc90-46ef-83e5-60a26c0b6ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:40.284728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e546d0-cc90-46ef-83e5-60a26c0b6ba2 None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:40.285799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e546d0-cc90-46ef-83e5-60a26c0b6ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=24fa245953b04b2a96af40db57c95867)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:40.287186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e546d0-cc90-46ef-83e5-60a26c0b6ba2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:40.289380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 557/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:40 2022] GET /identity/v3/projects/24fa245953b04b2a96af40db57c95867 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:40.295244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:40.390656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa677-2100-45e7-8527-7160dbc60740 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:40.422702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4984c8c-34b6-4439-8db5-9d61c290432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:40.423331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4984c8c-34b6-4439-8db5-9d61c290432f None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:40.423630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4984c8c-34b6-4439-8db5-9d61c290432f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:40.423902 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4984c8c-34b6-4439-8db5-9d61c290432f None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867/users/687a440df34c4a3583b6c78a012205cb/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:40.425962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4984c8c-34b6-4439-8db5-9d61c290432f None admin] RBAC: Authorizing `identity:create_grant(project_id=24fa245953b04b2a96af40db57c95867, user_id=687a440df34c4a3583b6c78a012205cb, role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:40.427370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4984c8c-34b6-4439-8db5-9d61c290432f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:40.473667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 566/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:31:40 2022] PUT /identity/v3/projects/24fa245953b04b2a96af40db57c95867/users/687a440df34c4a3583b6c78a012205cb/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:31:42.621819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5e4da-c884-4780-93b4-8514ca96ed45 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:42.622350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5e4da-c884-4780-93b4-8514ca96ed45 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:42.622350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5e4da-c884-4780-93b4-8514ca96ed45 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:42.623728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 558/1124] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:42.628885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e04de-ada0-41f7-8392-98bca8b03f56 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:42.629325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e04de-ada0-41f7-8392-98bca8b03f56 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:42.629420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e04de-ada0-41f7-8392-98bca8b03f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:42.647280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-961e04de-ada0-41f7-8392-98bca8b03f56 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:42.649029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-961e04de-ada0-41f7-8392-98bca8b03f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:42.697462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:42.713404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 567/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:42.988431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5e4da-c884-4780-93b4-8514ca96ed45 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:43.086584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5e4da-c884-4780-93b4-8514ca96ed45 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:43.118668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:43.119281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:43.119591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:43.119869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] PATH_INFO: `/v3/roles/d52ecebdbdbc4df4be5aae8c54c4c729` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:43.121235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] RBAC: Authorizing `identity:get_role(role_id=d52ecebdbdbc4df4be5aae8c54c4c729)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:43.122579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:43.123904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 559/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:42 2022] GET /identity/v3/roles/d52ecebdbdbc4df4be5aae8c54c4c729 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:43.129665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e04de-ada0-41f7-8392-98bca8b03f56 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:43.226580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e04de-ada0-41f7-8392-98bca8b03f56 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:43.262038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:43.262656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:43.262931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:43.264024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] PATH_INFO: `/v3/users/687a440df34c4a3583b6c78a012205cb` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:43.265127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] RBAC: Authorizing `identity:get_user(user_id=687a440df34c4a3583b6c78a012205cb)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:43.267364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:43.268948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 568/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:43 2022] GET /identity/v3/users/687a440df34c4a3583b6c78a012205cb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:43.275449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:43.332124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:43.371718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08522289-042e-4a9f-b445-4d6b3365f257 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:43.404371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:43.404961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:43.405239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:43.405507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:43.468564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:43.469980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:43.524328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:43.563829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 560/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:43.570049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:43.623559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:43.668269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48a15-c551-447e-8b8a-9f99110935fb None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:43.700394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcacf49-9d44-41a1-9993-20c66134421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:43.701054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcacf49-9d44-41a1-9993-20c66134421a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:43.701331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcacf49-9d44-41a1-9993-20c66134421a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:43.701599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcacf49-9d44-41a1-9993-20c66134421a None admin] PATH_INFO: `/v3/projects/24fa245953b04b2a96af40db57c95867` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:43.702677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcacf49-9d44-41a1-9993-20c66134421a None admin] RBAC: Authorizing `identity:get_project(project_id=24fa245953b04b2a96af40db57c95867)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:43.704113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcacf49-9d44-41a1-9993-20c66134421a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:43.705809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 569/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:43 2022] GET /identity/v3/projects/24fa245953b04b2a96af40db57c95867 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:43.712808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:43.807947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f790dd-a1f3-4630-842d-ba10b4c08a13 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:43.840935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bb473-1619-43d7-800f-5225118a7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:43.841527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb473-1619-43d7-800f-5225118a7b15 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:43.841810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb473-1619-43d7-800f-5225118a7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:43.842083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bb473-1619-43d7-800f-5225118a7b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:43.842802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bb473-1619-43d7-800f-5225118a7b15 None admin] RBAC: Adding query filter params (role.id=d52ecebdbdbc4df4be5aae8c54c4c729, scope.project.id=24fa245953b04b2a96af40db57c95867, user.id=687a440df34c4a3583b6c78a012205cb) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:43.843113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bb473-1619-43d7-800f-5225118a7b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:43.844560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bb473-1619-43d7-800f-5225118a7b15 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:43.850034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 561/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:43 2022] GET /identity/v3/role_assignments?user.id=687a440df34c4a3583b6c78a012205cb&scope.project.id=24fa245953b04b2a96af40db57c95867&role.id=d52ecebdbdbc4df4be5aae8c54c4c729 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:46.015953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0098-8d2a-45bb-9a22-ab5fd076a53e None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:46.016451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0098-8d2a-45bb-9a22-ab5fd076a53e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:46.016542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0098-8d2a-45bb-9a22-ab5fd076a53e None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:46.017834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 570/1131] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:46.023811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff90d57-2ac0-433a-8033-4b68375015e3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:46.024237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff90d57-2ac0-433a-8033-4b68375015e3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:46.024385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff90d57-2ac0-433a-8033-4b68375015e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:46.041983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-cff90d57-2ac0-433a-8033-4b68375015e3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:46.043154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cff90d57-2ac0-433a-8033-4b68375015e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:46.059327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:46.108602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 562/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:46.377118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0098-8d2a-45bb-9a22-ab5fd076a53e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:46.475157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0098-8d2a-45bb-9a22-ab5fd076a53e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:46.498171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:46.510487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb59938-3238-48e1-a087-b17ecb8073a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:46.511125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59938-3238-48e1-a087-b17ecb8073a1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:46.511508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59938-3238-48e1-a087-b17ecb8073a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:46.511741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb59938-3238-48e1-a087-b17ecb8073a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:46.512846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb59938-3238-48e1-a087-b17ecb8073a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:46.514281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb59938-3238-48e1-a087-b17ecb8073a1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:46.516159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 571/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:46.521865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff90d57-2ac0-433a-8033-4b68375015e3 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:46.621625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff90d57-2ac0-433a-8033-4b68375015e3 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:46.656631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd358805-c9c8-495a-b2ea-b5e9ee4893b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:46.657169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd358805-c9c8-495a-b2ea-b5e9ee4893b6 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:46.657447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd358805-c9c8-495a-b2ea-b5e9ee4893b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:46.657718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd358805-c9c8-495a-b2ea-b5e9ee4893b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:46.658370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd358805-c9c8-495a-b2ea-b5e9ee4893b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:46.659864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd358805-c9c8-495a-b2ea-b5e9ee4893b6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:46.748073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 563/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:31:46 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:48.910854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec37e8-1d75-498e-90c8-af1b9920d286 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:48.911389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec37e8-1d75-498e-90c8-af1b9920d286 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:48.911389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec37e8-1d75-498e-90c8-af1b9920d286 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:48.912785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 572/1135] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:48.918758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536358-8acd-4b92-8d92-37bb76d8a4e1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:48.919197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536358-8acd-4b92-8d92-37bb76d8a4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:48.919301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536358-8acd-4b92-8d92-37bb76d8a4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:48.926584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:48.938109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0a536358-8acd-4b92-8d92-37bb76d8a4e1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:48.949497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0a536358-8acd-4b92-8d92-37bb76d8a4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:49.005115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 564/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:49.275740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec37e8-1d75-498e-90c8-af1b9920d286 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:49.373345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec37e8-1d75-498e-90c8-af1b9920d286 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:49.405688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6c4f-dbf9-46ab-a1c0-39784d006ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:49.406292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6c4f-dbf9-46ab-a1c0-39784d006ffb None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:49.406566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6c4f-dbf9-46ab-a1c0-39784d006ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:49.406831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6c4f-dbf9-46ab-a1c0-39784d006ffb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:49.407923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6c4f-dbf9-46ab-a1c0-39784d006ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:49.409332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6c4f-dbf9-46ab-a1c0-39784d006ffb None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:49.410855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 573/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:31:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:49.416851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536358-8acd-4b92-8d92-37bb76d8a4e1 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:49.512251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536358-8acd-4b92-8d92-37bb76d8a4e1 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:49.544638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b8fe2-2b86-4fed-aeb9-3236c3466b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:49.545173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8fe2-2b86-4fed-aeb9-3236c3466b91 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:49.545455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8fe2-2b86-4fed-aeb9-3236c3466b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:49.545729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b8fe2-2b86-4fed-aeb9-3236c3466b91 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:49.546380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b8fe2-2b86-4fed-aeb9-3236c3466b91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:49.547818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b8fe2-2b86-4fed-aeb9-3236c3466b91 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:49.556277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:49.641986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 565/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:31:49 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:31:51.865994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14864886-26a8-4206-acc5-11bc8c2591d5 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:51.866701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14864886-26a8-4206-acc5-11bc8c2591d5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:51.866701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14864886-26a8-4206-acc5-11bc8c2591d5 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:51.867958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 574/1139] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:51.873107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a1ae-354c-46e6-a012-148f0f94c331 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:51.873498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a1ae-354c-46e6-a012-148f0f94c331 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:51.873661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a1ae-354c-46e6-a012-148f0f94c331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:51.892116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-fb50a1ae-354c-46e6-a012-148f0f94c331 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:51.893293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fb50a1ae-354c-46e6-a012-148f0f94c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:51.959298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 566/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:52.233727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14864886-26a8-4206-acc5-11bc8c2591d5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:52.295501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:52.336982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14864886-26a8-4206-acc5-11bc8c2591d5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:52.369119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:52.369731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:52.370009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:52.370281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:52.380813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:52.386398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:52.387655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:52.388782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 575/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:31:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:31:52.395830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a1ae-354c-46e6-a012-148f0f94c331 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:52.489124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a1ae-354c-46e6-a012-148f0f94c331 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:52.509763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:52.522943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:52.524942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:52.524942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:52.524942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:52.524942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:52.525302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:52.526389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:52.533993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 567/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:31:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:52.540509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:52.641677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce47b0-1422-49d2-aebe-f3846429c914 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:52.658697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:52.674384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:52.674997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:52.675275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:52.675575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] PATH_INFO: `/v3/users/6afbbfba6cce44e78484c68e78eaca9c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:52.687995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] RBAC: Authorizing `identity:get_user(user_id=6afbbfba6cce44e78484c68e78eaca9c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:52.689416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:52.691222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 576/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:52 2022] GET /identity/v3/users/6afbbfba6cce44e78484c68e78eaca9c => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:52.697752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:52.794295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fef54-634d-4a04-9542-f1fc5d55ad49 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:52.826758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:52.827349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:52.827666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:52.827942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:52.874267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:52.892487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:52.893900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:52.988624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 568/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:52.995106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:53.091759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b821-f8e9-45e5-8d41-8afdcfb79b53 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:53.124287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cc4f2-4d60-4588-bcd2-8320b1806ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:53.124896 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc4f2-4d60-4588-bcd2-8320b1806ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:53.125174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc4f2-4d60-4588-bcd2-8320b1806ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:53.125443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cc4f2-4d60-4588-bcd2-8320b1806ae1 None admin] PATH_INFO: `/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:53.126537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cc4f2-4d60-4588-bcd2-8320b1806ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=4dfe0403f8894ccf9bf7a203dd58fd5f)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:53.127988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cc4f2-4d60-4588-bcd2-8320b1806ae1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:53.129573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 577/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:52 2022] GET /identity/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:53.136412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:53.214195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:53.231153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065bdd5-1c74-4970-b1ea-943853bc624d None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:53.264665 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc67b7c-e84c-4b58-ad75-bcc888e98f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:53.265258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67b7c-e84c-4b58-ad75-bcc888e98f39 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:53.265536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67b7c-e84c-4b58-ad75-bcc888e98f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:53.265807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67b7c-e84c-4b58-ad75-bcc888e98f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:53.266515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc67b7c-e84c-4b58-ad75-bcc888e98f39 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=4dfe0403f8894ccf9bf7a203dd58fd5f, user.id=6afbbfba6cce44e78484c68e78eaca9c) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:53.266817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc67b7c-e84c-4b58-ad75-bcc888e98f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:53.268240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc67b7c-e84c-4b58-ad75-bcc888e98f39 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:53.273410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 569/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:53 2022] GET /identity/v3/role_assignments?user.id=6afbbfba6cce44e78484c68e78eaca9c&scope.project.id=4dfe0403f8894ccf9bf7a203dd58fd5f&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:55.374574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9a2e-fa8c-4c44-a92a-dcacbc14d8e6 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:55.375115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9a2e-fa8c-4c44-a92a-dcacbc14d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:55.375115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9a2e-fa8c-4c44-a92a-dcacbc14d8e6 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:55.376492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 578/1147] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:55.381657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862ac9-762a-4b35-a45b-a9dd87d0ff3e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:55.382118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862ac9-762a-4b35-a45b-a9dd87d0ff3e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:55.382220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862ac9-762a-4b35-a45b-a9dd87d0ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:55.400570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-be862ac9-762a-4b35-a45b-a9dd87d0ff3e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:55.401731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-be862ac9-762a-4b35-a45b-a9dd87d0ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:55.465491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 570/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:55.733288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9a2e-fa8c-4c44-a92a-dcacbc14d8e6 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:55.779685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:55.833146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9a2e-fa8c-4c44-a92a-dcacbc14d8e6 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:55.866008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:55.867222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:55.867582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:55.867851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:55.877637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:55.882457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:55.883901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:31:55.885097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 579/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:31:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:55.890017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be862ac9-762a-4b35-a45b-a9dd87d0ff3e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:55.969966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:55.991302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be862ac9-762a-4b35-a45b-a9dd87d0ff3e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:56.025504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:56.026101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:56.026380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:56.026652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:56.027305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:56.027635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:56.028976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:56.036677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 571/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:56.043035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:56.142197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890267e-0a5c-431a-8698-e9a693435996 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:56.144455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:56.174943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:56.175625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:56.176102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:56.176543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] PATH_INFO: `/v3/users/6afbbfba6cce44e78484c68e78eaca9c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:56.177916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] RBAC: Authorizing `identity:get_user(user_id=6afbbfba6cce44e78484c68e78eaca9c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:56.179552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:56.181089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 580/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:56 2022] GET /identity/v3/users/6afbbfba6cce44e78484c68e78eaca9c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:56.186820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:56.284822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bd609-428e-4882-84d9-5caffb942bb6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:56.316446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a118526-7e69-4d9e-96cb-a483d358ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:56.317063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118526-7e69-4d9e-96cb-a483d358ea47 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:56.317342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118526-7e69-4d9e-96cb-a483d358ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:56.317618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118526-7e69-4d9e-96cb-a483d358ea47 None admin] PATH_INFO: `/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:56.318721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a118526-7e69-4d9e-96cb-a483d358ea47 None admin] RBAC: Authorizing `identity:get_project(project_id=4dfe0403f8894ccf9bf7a203dd58fd5f)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:56.320730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a118526-7e69-4d9e-96cb-a483d358ea47 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:56.322418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 572/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:56 2022] GET /identity/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:56.328310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:56.423390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cbf51-ad92-40b1-8c00-286f205c5d4a None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:56.456432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88c696-4e57-431d-bce3-7ead3a909b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:56.457065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88c696-4e57-431d-bce3-7ead3a909b0c None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:56.457341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88c696-4e57-431d-bce3-7ead3a909b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:56.457611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88c696-4e57-431d-bce3-7ead3a909b0c None admin] PATH_INFO: `/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f/users/6afbbfba6cce44e78484c68e78eaca9c/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:56.459458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88c696-4e57-431d-bce3-7ead3a909b0c None admin] RBAC: Authorizing `identity:create_grant(project_id=4dfe0403f8894ccf9bf7a203dd58fd5f, user_id=6afbbfba6cce44e78484c68e78eaca9c, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:56.461155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88c696-4e57-431d-bce3-7ead3a909b0c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:56.547443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 581/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:31:56 2022] PUT /identity/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f/users/6afbbfba6cce44e78484c68e78eaca9c/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:31:58.746782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b2598-96ef-4db0-a3f4-a1f63c1a0794 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:58.754564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b2598-96ef-4db0-a3f4-a1f63c1a0794 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:58.754564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b2598-96ef-4db0-a3f4-a1f63c1a0794 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:58.754564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 573/1154] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:31:58.754845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb607-49aa-410f-b7f1-10b301f95c6a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:58.754845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb607-49aa-410f-b7f1-10b301f95c6a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:58.754845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb607-49aa-410f-b7f1-10b301f95c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:58.774130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-621fb607-49aa-410f-b7f1-10b301f95c6a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:31:58.775310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-621fb607-49aa-410f-b7f1-10b301f95c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:31:58.801088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:58.842767 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 582/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:31:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:31:59.114834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b2598-96ef-4db0-a3f4-a1f63c1a0794 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:59.124723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:59.214538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b2598-96ef-4db0-a3f4-a1f63c1a0794 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:59.246942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:59.247575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:59.247855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:59.248124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:59.257787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:31:59.262778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:31:59.263968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:31:59.265166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 574/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:31:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:31:59.269887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb607-49aa-410f-b7f1-10b301f95c6a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:59.367064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb607-49aa-410f-b7f1-10b301f95c6a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:59.399798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:59.400393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:59.400670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:59.400940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:59.401597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:31:59.401897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:59.403260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:59.411019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 583/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:31:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:59.417371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:59.480632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:59.513822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a95dd-2f96-45ab-aea9-07c397d89ca4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:59.546237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:59.546844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:59.547125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:59.547399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] PATH_INFO: `/v3/users/6afbbfba6cce44e78484c68e78eaca9c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:59.548533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] RBAC: Authorizing `identity:get_user(user_id=6afbbfba6cce44e78484c68e78eaca9c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:59.549941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:59.551491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 575/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:31:59 2022] GET /identity/v3/users/6afbbfba6cce44e78484c68e78eaca9c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:59.557845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:59.582069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:59.654034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7b34-b21c-40b3-b38f-1c9ee6cd5323 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:59.686729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:59.687338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:59.687633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:59.687902 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:59.751492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:59.752909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:59.775982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:59.846070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 584/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:31:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:59.852589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:31:59.950884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4774c1-750f-418b-898a-60ff5f4df965 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:31:59.983681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f06218-1f9f-4ca1-a798-ad7ca076aacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:31:59.984308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06218-1f9f-4ca1-a798-ad7ca076aacd None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:31:59.984592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06218-1f9f-4ca1-a798-ad7ca076aacd None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:31:59.984868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f06218-1f9f-4ca1-a798-ad7ca076aacd None admin] PATH_INFO: `/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:31:59.985976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06218-1f9f-4ca1-a798-ad7ca076aacd None admin] RBAC: Authorizing `identity:get_project(project_id=4dfe0403f8894ccf9bf7a203dd58fd5f)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:31:59.987577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f06218-1f9f-4ca1-a798-ad7ca076aacd None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:31:59.989181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 576/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:31:59 2022] GET /identity/v3/projects/4dfe0403f8894ccf9bf7a203dd58fd5f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:31:59.995595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:00.091125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c26de-ab32-4028-a49e-7881701125b4 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:00.112738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:00.122857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c08fc7-483e-46b4-ae22-1fa761208b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:00.123467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c08fc7-483e-46b4-ae22-1fa761208b86 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:00.124071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c08fc7-483e-46b4-ae22-1fa761208b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:00.124071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c08fc7-483e-46b4-ae22-1fa761208b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:00.124725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c08fc7-483e-46b4-ae22-1fa761208b86 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=4dfe0403f8894ccf9bf7a203dd58fd5f, user.id=6afbbfba6cce44e78484c68e78eaca9c) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:32:00.125032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c08fc7-483e-46b4-ae22-1fa761208b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:00.126439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c08fc7-483e-46b4-ae22-1fa761208b86 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:00.131922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 585/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:31:59 2022] GET /identity/v3/role_assignments?user.id=6afbbfba6cce44e78484c68e78eaca9c&scope.project.id=4dfe0403f8894ccf9bf7a203dd58fd5f&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:02.284142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe493d-ce06-471d-bef7-7e9e1c3de91c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:02.284648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe493d-ce06-471d-bef7-7e9e1c3de91c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:02.284741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe493d-ce06-471d-bef7-7e9e1c3de91c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:02.286012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 577/1162] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:32:02.291139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba7e3-a5a0-4b44-a6aa-39f36f302505 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:02.291602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba7e3-a5a0-4b44-a6aa-39f36f302505 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:02.291697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba7e3-a5a0-4b44-a6aa-39f36f302505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:02.309515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b57ba7e3-a5a0-4b44-a6aa-39f36f302505 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:32:02.310676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b57ba7e3-a5a0-4b44-a6aa-39f36f302505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:32:02.375167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 586/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:32:02.645942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe493d-ce06-471d-bef7-7e9e1c3de91c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:02.648861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:02.745162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe493d-ce06-471d-bef7-7e9e1c3de91c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:02.777888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:02.778482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:02.778762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:02.779033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:02.843172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:02.844618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:02.846339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:02.940365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 578/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:32:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:32:02.947067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba7e3-a5a0-4b44-a6aa-39f36f302505 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:03.048226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba7e3-a5a0-4b44-a6aa-39f36f302505 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:03.065639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:03.082319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005625e-ca90-4bdf-91b4-5413f64faf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:03.082940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005625e-ca90-4bdf-91b4-5413f64faf2e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:03.083221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005625e-ca90-4bdf-91b4-5413f64faf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:03.083530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005625e-ca90-4bdf-91b4-5413f64faf2e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:03.090524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005625e-ca90-4bdf-91b4-5413f64faf2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:03.092019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005625e-ca90-4bdf-91b4-5413f64faf2e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-c005625e-ca90-4bdf-91b4-5413f64faf2e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:32:03.104429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:32:03.105685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:32:03.106763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 587/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:32:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:32:03.111713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:03.205892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1a11-c5c7-4ee4-ae91-3545e148e026 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:03.207310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:03.238974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c128d4-78e6-4023-8d82-ea86a98db804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:03.239596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c128d4-78e6-4023-8d82-ea86a98db804 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:03.239873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c128d4-78e6-4023-8d82-ea86a98db804 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:03.240144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c128d4-78e6-4023-8d82-ea86a98db804 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:03.240776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c128d4-78e6-4023-8d82-ea86a98db804 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:32:03.241090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c128d4-78e6-4023-8d82-ea86a98db804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:03.243855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c128d4-78e6-4023-8d82-ea86a98db804 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:03.250660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 579/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 28 08:32:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:05.385571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c00f3-7d53-4c83-91cb-e8b2f91a5437 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:05.386094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c00f3-7d53-4c83-91cb-e8b2f91a5437 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:05.386094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c00f3-7d53-4c83-91cb-e8b2f91a5437 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:05.387425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 588/1167] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:32:05.392622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec320b4-339e-4d8c-ae4d-96069d30b6da None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:05.393017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec320b4-339e-4d8c-ae4d-96069d30b6da None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:05.393178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec320b4-339e-4d8c-ae4d-96069d30b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:05.412239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2ec320b4-339e-4d8c-ae4d-96069d30b6da None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:32:05.414367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2ec320b4-339e-4d8c-ae4d-96069d30b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:32:05.479316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 580/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:32:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:32:05.757053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c00f3-7d53-4c83-91cb-e8b2f91a5437 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:05.856148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c00f3-7d53-4c83-91cb-e8b2f91a5437 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:05.888518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bf602-e718-49ca-8e50-75d29f880f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:05.889112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bf602-e718-49ca-8e50-75d29f880f6e None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:05.889394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bf602-e718-49ca-8e50-75d29f880f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:05.889668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bf602-e718-49ca-8e50-75d29f880f6e None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:05.890332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bf602-e718-49ca-8e50-75d29f880f6e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:05.891720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bf602-e718-49ca-8e50-75d29f880f6e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:05.975306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 589/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Wed Sep 28 08:32:05 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:32:08.140135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682a14-b764-4139-9156-a9e7e98ccc0e None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:08.140647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682a14-b764-4139-9156-a9e7e98ccc0e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:08.140765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682a14-b764-4139-9156-a9e7e98ccc0e None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:08.142019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 581/1170] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:32:08.147778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d952db-6be6-4b14-afe3-6b2265ea85d2 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:08.148267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d952db-6be6-4b14-afe3-6b2265ea85d2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:08.148544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d952db-6be6-4b14-afe3-6b2265ea85d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:08.166815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f5d952db-6be6-4b14-afe3-6b2265ea85d2 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:32:08.168013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f5d952db-6be6-4b14-afe3-6b2265ea85d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:32:08.197799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:08.233147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 590/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:32:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 28 08:32:08.504883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682a14-b764-4139-9156-a9e7e98ccc0e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:08.597182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:08.603685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682a14-b764-4139-9156-a9e7e98ccc0e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:08.637556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb32a-ba08-4235-80c7-3e4d67d38333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:08.638170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb32a-ba08-4235-80c7-3e4d67d38333 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:08.638458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb32a-ba08-4235-80c7-3e4d67d38333 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:08.638731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb32a-ba08-4235-80c7-3e4d67d38333 None admin] PATH_INFO: `/v3/domains/a7b2347a2b4a4f2f8ef01d2697ffeac7` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:08.648980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fb32a-ba08-4235-80c7-3e4d67d38333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7b2347a2b4a4f2f8ef01d2697ffeac7)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:08.650403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fb32a-ba08-4235-80c7-3e4d67d38333 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:08.651988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 582/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Wed Sep 28 08:32:08 2022] GET /identity/v3/domains/a7b2347a2b4a4f2f8ef01d2697ffeac7 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:08.657836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d952db-6be6-4b14-afe3-6b2265ea85d2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:08.753684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d952db-6be6-4b14-afe3-6b2265ea85d2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:08.786634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645d835-a0d5-4b1e-9f49-0326810b4586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:08.787223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645d835-a0d5-4b1e-9f49-0326810b4586 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:08.787527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645d835-a0d5-4b1e-9f49-0326810b4586 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:08.787819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645d835-a0d5-4b1e-9f49-0326810b4586 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:08.788464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645d835-a0d5-4b1e-9f49-0326810b4586 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:08.789876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645d835-a0d5-4b1e-9f49-0326810b4586 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:08.877270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 591/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:32:08 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:32:11.058973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f0b7-7f33-4e38-815d-2323f1990d57 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:11.059605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f0b7-7f33-4e38-815d-2323f1990d57 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:11.059605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f0b7-7f33-4e38-815d-2323f1990d57 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:11.060903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 583/1174] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:32:11.066203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a91bf-89d2-405a-a4a0-5e53964dd6c7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:11.066604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a91bf-89d2-405a-a4a0-5e53964dd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:11.066752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a91bf-89d2-405a-a4a0-5e53964dd6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:11.085394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a15a91bf-89d2-405a-a4a0-5e53964dd6c7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:32:11.086559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a15a91bf-89d2-405a-a4a0-5e53964dd6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:32:11.100063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:11.152108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 592/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:32:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:32:11.425473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f0b7-7f33-4e38-815d-2323f1990d57 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:11.522387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f0b7-7f33-4e38-815d-2323f1990d57 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:11.554578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088b692-7595-4ce4-ab4e-f40788f465fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:11.555184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b692-7595-4ce4-ab4e-f40788f465fa None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:11.555490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b692-7595-4ce4-ab4e-f40788f465fa None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:11.555766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088b692-7595-4ce4-ab4e-f40788f465fa None admin] PATH_INFO: `/v3/domains/a7b2347a2b4a4f2f8ef01d2697ffeac7` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:11.556863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088b692-7595-4ce4-ab4e-f40788f465fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7b2347a2b4a4f2f8ef01d2697ffeac7)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:11.558265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088b692-7595-4ce4-ab4e-f40788f465fa None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:11.559820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 584/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Wed Sep 28 08:32:11 2022] GET /identity/v3/domains/a7b2347a2b4a4f2f8ef01d2697ffeac7 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:11.565346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a91bf-89d2-405a-a4a0-5e53964dd6c7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:11.662418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a91bf-89d2-405a-a4a0-5e53964dd6c7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:11.699230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87a25-aced-462a-b941-e02a8c6bce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:11.699793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87a25-aced-462a-b941-e02a8c6bce08 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:11.700075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87a25-aced-462a-b941-e02a8c6bce08 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:11.700344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87a25-aced-462a-b941-e02a8c6bce08 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:11.700992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87a25-aced-462a-b941-e02a8c6bce08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:11.702417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87a25-aced-462a-b941-e02a8c6bce08 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:11.819824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 593/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:32:11 2022] POST /identity/v3/users => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:32:14.004209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa560a8-29d6-44b7-a3ea-8b609be20e43 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:14.004683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa560a8-29d6-44b7-a3ea-8b609be20e43 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:14.004773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa560a8-29d6-44b7-a3ea-8b609be20e43 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:14.006086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 585/1178] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:32:14.012181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900feb-cee9-477a-9ee5-4817c6b39ab6 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:14.012603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900feb-cee9-477a-9ee5-4817c6b39ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:14.012733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900feb-cee9-477a-9ee5-4817c6b39ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:14.025650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:14.030931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c8900feb-cee9-477a-9ee5-4817c6b39ab6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:32:14.032146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c8900feb-cee9-477a-9ee5-4817c6b39ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:32:14.100532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 594/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:32:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:32:14.369271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa560a8-29d6-44b7-a3ea-8b609be20e43 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:14.394492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:14.471901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa560a8-29d6-44b7-a3ea-8b609be20e43 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:14.504482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:14.505103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:14.505382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:14.505652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:14.516035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:32:14.520799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:32:14.522741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:32:14.523746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 586/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:32:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:32:14.528618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900feb-cee9-477a-9ee5-4817c6b39ab6 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:14.624049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900feb-cee9-477a-9ee5-4817c6b39ab6 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:14.656781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:14.657373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:14.657653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:14.657925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:14.658578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:32:14.658880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:14.660265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:14.662361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:14.668419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 595/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:14.674249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:14.756313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:14.772201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802f63e-9029-442d-a0aa-6566b5cda167 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:14.805077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:14.805880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:14.806535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:14.806810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] PATH_INFO: `/v3/users/05e1b031ac684bc1a43facf0a40b4827` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:14.821036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] RBAC: Authorizing `identity:get_user(user_id=05e1b031ac684bc1a43facf0a40b4827)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:14.822450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:14.824128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 587/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:32:14 2022] GET /identity/v3/users/05e1b031ac684bc1a43facf0a40b4827 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:14.829973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:14.926468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89082-197a-4914-bf75-26b43c1add60 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:14.959698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:14.960289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:14.960569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:14.960842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:15.022791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:15.026130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:15.027599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:15.122069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 596/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:32:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:32:15.128151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:15.223347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570c78d-e9e3-4225-b1f7-ee2891b933ee None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:15.256628 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a1d7b-9ee5-4cf5-8f5e-3376e649d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:15.257498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1d7b-9ee5-4cf5-8f5e-3376e649d3fc None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:15.257785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1d7b-9ee5-4cf5-8f5e-3376e649d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:15.258059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a1d7b-9ee5-4cf5-8f5e-3376e649d3fc None admin] PATH_INFO: `/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:15.259157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1d7b-9ee5-4cf5-8f5e-3376e649d3fc None admin] RBAC: Authorizing `identity:get_project(project_id=d33b41f5939f4f4cbc4b9e165655d7c0)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:15.260604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a1d7b-9ee5-4cf5-8f5e-3376e649d3fc None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:15.262189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 588/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:32:15 2022] GET /identity/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:15.268291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:15.360137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:15.363779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d83f8-a147-4679-adcf-5dc719b184b9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:15.398615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea62bd0-c9da-4ec5-9ab1-d7308703ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:15.399191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62bd0-c9da-4ec5-9ab1-d7308703ab75 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:15.399489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62bd0-c9da-4ec5-9ab1-d7308703ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:15.399761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62bd0-c9da-4ec5-9ab1-d7308703ab75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:15.400466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea62bd0-c9da-4ec5-9ab1-d7308703ab75 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=d33b41f5939f4f4cbc4b9e165655d7c0, user.id=05e1b031ac684bc1a43facf0a40b4827) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:32:15.400766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea62bd0-c9da-4ec5-9ab1-d7308703ab75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:15.402170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea62bd0-c9da-4ec5-9ab1-d7308703ab75 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:15.407344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 597/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:32:15 2022] GET /identity/v3/role_assignments?user.id=05e1b031ac684bc1a43facf0a40b4827&scope.project.id=d33b41f5939f4f4cbc4b9e165655d7c0&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:32:17.507500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5ea2-11bd-4a62-8a4f-b9feff6873b7 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:17.508023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5ea2-11bd-4a62-8a4f-b9feff6873b7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:17.508135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc5ea2-11bd-4a62-8a4f-b9feff6873b7 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:17.509428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 589/1186] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:32:17.514579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e9e9-d2e6-4e50-bfc8-c3dfb39b779d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:17.514983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e9e9-d2e6-4e50-bfc8-c3dfb39b779d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:17.515121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8e9e9-d2e6-4e50-bfc8-c3dfb39b779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:17.532831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e6e8e9e9-d2e6-4e50-bfc8-c3dfb39b779d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:32:17.533985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e6e8e9e9-d2e6-4e50-bfc8-c3dfb39b779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:32:17.597702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 598/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:32:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:32:17.865181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc5ea2-11bd-4a62-8a4f-b9feff6873b7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:17.877440 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:17.964916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc5ea2-11bd-4a62-8a4f-b9feff6873b7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:17.998838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:17.999485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:17.999770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:18.000066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:18.010697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:32:18.015648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:32:18.016763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:32:18.017881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 590/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:32:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:32:18.023872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e9e9-d2e6-4e50-bfc8-c3dfb39b779d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:18.113282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:18.130794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8e9e9-d2e6-4e50-bfc8-c3dfb39b779d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:18.157260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:18.157879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:18.158159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:18.158433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:18.159088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:32:18.159389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:18.160806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:18.169523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 599/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:18.175347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:18.242745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:18.273197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c786ae-f6d9-4279-a355-40925402ca76 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:18.305177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:18.305779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:18.306062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:18.306333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] PATH_INFO: `/v3/users/05e1b031ac684bc1a43facf0a40b4827` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:18.307458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] RBAC: Authorizing `identity:get_user(user_id=05e1b031ac684bc1a43facf0a40b4827)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:18.308867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:18.310413 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 591/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:32:18 2022] GET /identity/v3/users/05e1b031ac684bc1a43facf0a40b4827 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:18.316178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:18.412956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07e2fa-f810-4114-80b5-bf052f623ea2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:18.445628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7fbbc-4906-413a-a331-7006e86f0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:18.446241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fbbc-4906-413a-a331-7006e86f0de1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:18.446520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fbbc-4906-413a-a331-7006e86f0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:18.446792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fbbc-4906-413a-a331-7006e86f0de1 None admin] PATH_INFO: `/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:18.447908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7fbbc-4906-413a-a331-7006e86f0de1 None admin] RBAC: Authorizing `identity:get_project(project_id=d33b41f5939f4f4cbc4b9e165655d7c0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:18.449322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7fbbc-4906-413a-a331-7006e86f0de1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:18.450908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 600/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:32:18 2022] GET /identity/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:18.456742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:18.553651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f3f17-459a-4534-ba66-94e95abac3be None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:18.585867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba355dc-5f6c-4980-a925-cb6b91af2db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:18.586500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba355dc-5f6c-4980-a925-cb6b91af2db8 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:18.586808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba355dc-5f6c-4980-a925-cb6b91af2db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:18.587082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba355dc-5f6c-4980-a925-cb6b91af2db8 None admin] PATH_INFO: `/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0/users/05e1b031ac684bc1a43facf0a40b4827/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:18.588969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba355dc-5f6c-4980-a925-cb6b91af2db8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d33b41f5939f4f4cbc4b9e165655d7c0, user_id=05e1b031ac684bc1a43facf0a40b4827, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:18.590366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba355dc-5f6c-4980-a925-cb6b91af2db8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:18.705216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:18.710527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 592/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:32:18 2022] PUT /identity/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0/users/05e1b031ac684bc1a43facf0a40b4827/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:32:20.840169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834536bd-e999-4125-8df3-e896e49c04a2 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:20.840690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834536bd-e999-4125-8df3-e896e49c04a2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:20.840690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834536bd-e999-4125-8df3-e896e49c04a2 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:20.842024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 601/1193] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:32:20.847113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4575-9396-4435-9f54-1985f003b9d2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:20.847523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4575-9396-4435-9f54-1985f003b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:20.847690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4575-9396-4435-9f54-1985f003b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:20.865828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3a5a4575-9396-4435-9f54-1985f003b9d2 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:32:20.867011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3a5a4575-9396-4435-9f54-1985f003b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:32:20.932157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 593/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:32:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:32:21.203126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834536bd-e999-4125-8df3-e896e49c04a2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:21.228178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:21.302474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834536bd-e999-4125-8df3-e896e49c04a2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:21.335240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:21.335876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:21.336153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:21.336422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:21.346047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:32:21.351436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:32:21.352560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:32:21.353661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 602/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:32:21.358709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a4575-9396-4435-9f54-1985f003b9d2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:21.453210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a4575-9396-4435-9f54-1985f003b9d2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:21.478526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:21.485747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:21.488920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:21.488920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:21.488920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:21.488920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:32:21.488920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:21.489474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:21.497062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 594/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:21.502971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:21.581210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:21.598859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5e880-3e2b-4321-a973-9a7654659988 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:21.632609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:21.633211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:21.633487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:21.633755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] PATH_INFO: `/v3/users/05e1b031ac684bc1a43facf0a40b4827` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:21.634839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] RBAC: Authorizing `identity:get_user(user_id=05e1b031ac684bc1a43facf0a40b4827)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:21.636271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:21.637807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 603/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 28 08:32:21 2022] GET /identity/v3/users/05e1b031ac684bc1a43facf0a40b4827 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:21.643535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:21.739008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474741-bef4-4225-a9df-2b1becd5b1eb None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:21.778542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:21.779135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:21.779411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:21.779712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:21.833161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:21.843778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:21.845204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:21.940700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 595/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:32:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:32:21.947194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:22.042880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bd7d3-26bd-49be-8b28-eabfe8b29f85 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:22.075035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea1500-f64e-4395-a4c9-94652f65e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:22.075669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1500-f64e-4395-a4c9-94652f65e990 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:22.075945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1500-f64e-4395-a4c9-94652f65e990 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:22.076214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1500-f64e-4395-a4c9-94652f65e990 None admin] PATH_INFO: `/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:22.077297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea1500-f64e-4395-a4c9-94652f65e990 None admin] RBAC: Authorizing `identity:get_project(project_id=d33b41f5939f4f4cbc4b9e165655d7c0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:22.078707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea1500-f64e-4395-a4c9-94652f65e990 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:22.080308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 604/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 28 08:32:21 2022] GET /identity/v3/projects/d33b41f5939f4f4cbc4b9e165655d7c0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:22.086781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:32:22.171192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:22.181016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318e8d4-5ee7-4fea-83df-7a3df856b3e4 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:32:22.213467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdae3c-522f-45ee-aeea-a4ff291e3647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:32:22.214052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdae3c-522f-45ee-aeea-a4ff291e3647 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:32:22.214326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdae3c-522f-45ee-aeea-a4ff291e3647 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:32:22.214595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdae3c-522f-45ee-aeea-a4ff291e3647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:32:22.215308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdae3c-522f-45ee-aeea-a4ff291e3647 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=d33b41f5939f4f4cbc4b9e165655d7c0, user.id=05e1b031ac684bc1a43facf0a40b4827) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:32:22.215637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdae3c-522f-45ee-aeea-a4ff291e3647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:32:22.217086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdae3c-522f-45ee-aeea-a4ff291e3647 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:32:22.222512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 596/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:32:22 2022] GET /identity/v3/role_assignments?user.id=05e1b031ac684bc1a43facf0a40b4827&scope.project.id=d33b41f5939f4f4cbc4b9e165655d7c0&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:32:32.071045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:32:32.220173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=23 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:35.738630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5adef-e34c-469c-a77e-24b442382fb9 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:35.739222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5adef-e34c-469c-a77e-24b442382fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:35.739222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5adef-e34c-469c-a77e-24b442382fb9 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:35.740540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 605/1201] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:33:35.746540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485d75-afd2-45f7-9d7b-73a52bd967aa None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:35.746972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485d75-afd2-45f7-9d7b-73a52bd967aa None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:35.747074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485d75-afd2-45f7-9d7b-73a52bd967aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:35.765945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2a485d75-afd2-45f7-9d7b-73a52bd967aa None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:33:35.767117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2a485d75-afd2-45f7-9d7b-73a52bd967aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:33:35.832240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 597/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:33:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:33:36.103887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5adef-e34c-469c-a77e-24b442382fb9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:36.204076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5adef-e34c-469c-a77e-24b442382fb9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:36.237720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:36.238330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:36.238606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:36.238870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:36.248842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:36.250279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:36.264663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:36.267658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:36.268692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:36.268692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:36.268692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:36.268692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 606/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:36.271958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485d75-afd2-45f7-9d7b-73a52bd967aa None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:36.369109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485d75-afd2-45f7-9d7b-73a52bd967aa None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:36.398342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:36.404924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f2ff3-b7d7-46f1-91cd-fb71efc8c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:36.405535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2ff3-b7d7-46f1-91cd-fb71efc8c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:36.405819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2ff3-b7d7-46f1-91cd-fb71efc8c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:36.406096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2ff3-b7d7-46f1-91cd-fb71efc8c8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:36.406735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f2ff3-b7d7-46f1-91cd-fb71efc8c8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:36.407037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f2ff3-b7d7-46f1-91cd-fb71efc8c8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:36.408452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f2ff3-b7d7-46f1-91cd-fb71efc8c8f8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:36.420601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 598/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:36.426431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:36.479199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:36.523507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde0b6-4f30-4860-85df-65b657c96f25 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:36.556334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c891a-ceb9-41ca-ad5c-233d5c0edc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:36.556924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c891a-ceb9-41ca-ad5c-233d5c0edc99 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:36.557202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c891a-ceb9-41ca-ad5c-233d5c0edc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:36.557472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c891a-ceb9-41ca-ad5c-233d5c0edc99 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:36.558109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c891a-ceb9-41ca-ad5c-233d5c0edc99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:36.559608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c891a-ceb9-41ca-ad5c-233d5c0edc99 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:36.714587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 607/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 28 08:33:36 2022] POST /identity/v3/users => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:33:38.907218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8f510-f0ad-4e5f-8345-124485e68a2e None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:38.907817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8f510-f0ad-4e5f-8345-124485e68a2e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:38.907926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8f510-f0ad-4e5f-8345-124485e68a2e None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:38.909212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 599/1206] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:33:38.914616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7026bf-3721-462a-88dc-dc7172ecce28 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:38.920054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7026bf-3721-462a-88dc-dc7172ecce28 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:38.920054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7026bf-3721-462a-88dc-dc7172ecce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:38.934184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ae7026bf-3721-462a-88dc-dc7172ecce28 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:33:38.935357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ae7026bf-3721-462a-88dc-dc7172ecce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:33:39.000267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 608/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:33:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:33:39.269561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8f510-f0ad-4e5f-8345-124485e68a2e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:39.370699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8f510-f0ad-4e5f-8345-124485e68a2e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:39.405840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:39.406469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:39.406753 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:39.407028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:39.417226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:33:39.422980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:39.424308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:39.425332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 600/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:39.430210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7026bf-3721-462a-88dc-dc7172ecce28 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:39.469474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:39.529013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7026bf-3721-462a-88dc-dc7172ecce28 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:39.561756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:39.562355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:39.562632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:39.562903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:39.563590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:39.563893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:39.565248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:39.573433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 609/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:39.579261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:39.628731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:39.676283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6c9a-a3d5-4551-9a19-33802de20c1c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:39.708558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:39.709179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:39.709456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:39.709726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:39.720078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:39.721551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:39.735908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:39.737206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:39.738478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:39.738478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:39.738478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:39.738478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 601/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:39.742942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:39.842342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:39.845110 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da2a13-0ecb-4fbe-a097-7edc36046897 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:39.879535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:39.880190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:39.880475 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:39.880742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:39.881371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:39.881666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:39.883007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:39.893849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 610/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:39.899594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:39.998697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db983167-ab45-42dc-b2f9-cd0f8b63a5f5 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:40.000261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:40.032426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:40.034712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:40.034712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:40.034712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:40.041282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:40.042744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:33:40.054055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:40.063698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:40.064924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 602/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:40.065728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:40.163738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be88c63-5d45-4a88-8171-811a2e2d8f1c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:40.201152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:40.201763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:40.202042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:40.202315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:40.203035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:40.203340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:40.204853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:40.222259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 611/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 28 08:33:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:40.229168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:40.331387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aed545-88ec-4a7c-95cc-2fa61016b102 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:40.365310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:40.365910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:40.366194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:40.366497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:40.396592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:40.434852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:40.436231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:40.534385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 603/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:33:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:33:40.540786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:40.560344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:40.640027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393b12d-3005-4762-94db-0d79b30687f6 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:40.674001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:40.674617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:40.674889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:40.675157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:40.685791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:40.687158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:40.702078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:40.703236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:40.704597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:40.704597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:40.704597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:40.704597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 612/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:40.708959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:40.769491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:40.807044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df0f8-5812-4c4a-b1f6-be0a794ea04c None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:40.839888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:40.843927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:40.843927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:40.843927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:40.843927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:40.843927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:40.843927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:40.855221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 604/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:40.860926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:40.931148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:40.963647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35875418-76bf-4587-980b-03bc0e808ac7 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:40.998147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:40.998778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:40.999062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:40.999338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:41.006254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:41.009896 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:33:41.018812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:41.024926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:41.026053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 613/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:41.026724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:41.122116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0d323-f6c4-4766-aeab-4fd9d57a82f0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:41.144366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:41.156063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1f648-ff6d-4fe5-996e-e4f9c211ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:41.156681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1f648-ff6d-4fe5-996e-e4f9c211ec1c None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:41.156962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1f648-ff6d-4fe5-996e-e4f9c211ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:41.157234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1f648-ff6d-4fe5-996e-e4f9c211ec1c None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:41.158007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1f648-ff6d-4fe5-996e-e4f9c211ec1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:41.158311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1f648-ff6d-4fe5-996e-e4f9c211ec1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:41.159747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1f648-ff6d-4fe5-996e-e4f9c211ec1c None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:41.171220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 605/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:41.177265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:41.284901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c302b00-64fc-409c-8eee-53e7f69d7c24 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:41.314237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:41.319979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e2d70-d321-4e82-bca1-3387df37d3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:41.320576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2d70-d321-4e82-bca1-3387df37d3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:41.320852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2d70-d321-4e82-bca1-3387df37d3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:41.321736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2d70-d321-4e82-bca1-3387df37d3d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:41.322594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e2d70-d321-4e82-bca1-3387df37d3d0 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=4b79ca72535543aeac33b949189ee4da) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:41.322897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e2d70-d321-4e82-bca1-3387df37d3d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:41.324352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e2d70-d321-4e82-bca1-3387df37d3d0 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:41.329901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 614/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:33:41 2022] GET /identity/v3/role_assignments?user.id=4b79ca72535543aeac33b949189ee4da&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:43.459450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc35002-5043-49a8-b574-4148063740ff None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:43.460040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc35002-5043-49a8-b574-4148063740ff None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:43.460040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc35002-5043-49a8-b574-4148063740ff None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:43.461339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 606/1220] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:33:43.468461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e7a3-6ebc-4af0-a4e8-654d8bd562a8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:43.468898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e7a3-6ebc-4af0-a4e8-654d8bd562a8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:43.469008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e7a3-6ebc-4af0-a4e8-654d8bd562a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:43.487860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9ce3e7a3-6ebc-4af0-a4e8-654d8bd562a8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:33:43.489043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9ce3e7a3-6ebc-4af0-a4e8-654d8bd562a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:33:43.553878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 615/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:33:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:33:43.834590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc35002-5043-49a8-b574-4148063740ff None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:43.936179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc35002-5043-49a8-b574-4148063740ff None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:43.969502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:43.970117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:43.970392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:43.970662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:43.980928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:33:43.985577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:43.986738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:43.987868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 607/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:43.992987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e7a3-6ebc-4af0-a4e8-654d8bd562a8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:44.093208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e7a3-6ebc-4af0-a4e8-654d8bd562a8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:44.116688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:44.127001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:44.127634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:44.127913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:44.128183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:44.129090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:44.129389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:44.130746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:44.138792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 616/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:33:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:33:44.144879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:44.188212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:44.244107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fec51c-b6ed-4288-bfdb-ae9a0c2f53a6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:44.280007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:44.280633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:44.280921 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:44.281198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:44.291521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:44.292958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:44.307751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:44.308891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:44.310221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:44.310221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:44.310221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:44.310221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 608/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:33:44.314749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:44.417618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a84c9-c0a0-46d6-b34c-bd147e07a4ad None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:44.450097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:44.450756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:44.451036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:44.451309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:44.451975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:44.452276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:44.453628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:44.465769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 617/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:44.471605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:44.562583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:44.568760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ebf0-fe6a-41bb-839d-ab40062bea9b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:44.600908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:44.601524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:44.601800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:44.602153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:44.608750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:44.610149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:33:44.621675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:44.622806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:44.623866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 609/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:44.628684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:44.679329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:44.731320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c29e28-751a-445d-8053-459a222d5303 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:44.764844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:44.765920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:44.765920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:44.766112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:44.766661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:44.766962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:44.768408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:44.785007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 618/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 28 08:33:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:44.791068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:44.887799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f763d12-83d0-4513-a4c3-c910f8a9349a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:44.919700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:44.920329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:44.920607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:44.920878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:44.931903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:44.933282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:44.947034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:44.948264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:44.949416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:44.949416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:44.949416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:44.949416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 610/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:44.954167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:45.056885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97842bf8-06d5-4448-b57f-f7c438d82636 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:45.059215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:45.090676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:45.091266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:45.091577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:45.091850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:45.092480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:45.092777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:45.094125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:45.104866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 619/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:45.110621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:45.121281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:45.210155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19129b-bdc6-4bb3-9192-df5608b3ffc6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:45.242300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:45.243744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:45.244019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:45.244289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:45.250743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:45.252213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:33:45.264033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:45.265119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:45.266403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 611/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:45.271106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:45.373157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a4031-a130-49e9-bdc4-67d45c66ecec None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:45.406058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd0d9f-228b-405f-ad2e-98297d3642b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:45.406646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0d9f-228b-405f-ad2e-98297d3642b3 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:45.406921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0d9f-228b-405f-ad2e-98297d3642b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:45.407187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd0d9f-228b-405f-ad2e-98297d3642b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:45.407891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd0d9f-228b-405f-ad2e-98297d3642b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:45.408190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd0d9f-228b-405f-ad2e-98297d3642b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:45.409637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd0d9f-228b-405f-ad2e-98297d3642b3 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:45.421044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 620/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:45.427549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:45.491712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:45.526472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbbe63-e249-416d-b1e8-cd72b7d2af52 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:45.558574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c2cd2-f6fb-494d-80e6-d523c23206d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:45.559306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2cd2-f6fb-494d-80e6-d523c23206d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:45.560049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2cd2-f6fb-494d-80e6-d523c23206d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:45.560500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2cd2-f6fb-494d-80e6-d523c23206d0 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/4b79ca72535543aeac33b949189ee4da/roles/6288c02347fc4743b28fbb9e17d55542` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:45.575517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c2cd2-f6fb-494d-80e6-d523c23206d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=4b79ca72535543aeac33b949189ee4da, role_id=6288c02347fc4743b28fbb9e17d55542)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:45.576944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c2cd2-f6fb-494d-80e6-d523c23206d0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:45.670927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 612/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:33:45 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/4b79ca72535543aeac33b949189ee4da/roles/6288c02347fc4743b28fbb9e17d55542 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:33:47.821273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64a67-efaf-476a-ad1a-ee239d5e99d3 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:47.821838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64a67-efaf-476a-ad1a-ee239d5e99d3 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:47.821838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64a67-efaf-476a-ad1a-ee239d5e99d3 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:47.823147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 621/1233] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:33:47.828572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ffd8-3106-4f26-9e93-63ba5712823e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:47.828971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ffd8-3106-4f26-9e93-63ba5712823e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:47.829116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ffd8-3106-4f26-9e93-63ba5712823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:47.846858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a9d4ffd8-3106-4f26-9e93-63ba5712823e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:33:47.848064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a9d4ffd8-3106-4f26-9e93-63ba5712823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:33:47.913737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 613/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:33:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:33:48.181638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64a67-efaf-476a-ad1a-ee239d5e99d3 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:48.206087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:48.282141 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64a67-efaf-476a-ad1a-ee239d5e99d3 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:48.316000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:48.316620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:48.316901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:48.317174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:48.327090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:33:48.331947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:48.333066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:48.333928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 622/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 28 08:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:48.339736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4ffd8-3106-4f26-9e93-63ba5712823e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:48.384990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:48.436395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4ffd8-3106-4f26-9e93-63ba5712823e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:48.469856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:48.470604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:48.470903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:48.471166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:48.471856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] RBAC: Adding query filter params (name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:48.472163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:48.473704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:48.482213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 614/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 28 08:33:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:48.488045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:48.572147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:48.587405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad5de-27b2-4128-b7c9-69ab4da1bf37 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:48.620648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:48.621264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:48.621543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:48.621815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:48.631909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:48.633382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:48.647325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:48.648483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:48.649439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:48.649439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:48.649439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:48.649439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 623/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:48.654416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:48.752726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd59312-3fc7-4ae6-9430-6c81ba17859a None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:48.761486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:48.785077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:48.785673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:48.785953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:48.786224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:48.786859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:48.787159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:48.788553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:48.800498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 615/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:48.806771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:48.905456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b2929-c624-4511-9c7b-7a6e9e3f878f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:48.938631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:48.939246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:48.939560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:48.939831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:48.942407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:48.947933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:48.949788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:33:48.962177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:48.963310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:48.964543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 624/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 28 08:33:48.971278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:49.072152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929192f-d142-433c-aef9-6dd98fdd0d9b None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:49.105358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:49.105952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:49.106230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:49.106501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:49.107213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:49.107542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:49.108936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:49.125283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 616/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 28 08:33:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:49.131239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:49.229184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0501761-004e-4ccc-b942-6adf02162ff1 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:49.264611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:49.265211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:49.265490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:49.265762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:49.326323 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:49.332671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:49.334114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:49.428866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 625/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:33:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 28 08:33:49.435363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:49.463000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:49.532914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adccf2e-0a9d-4212-9468-f9633c0c1ad1 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:49.566257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:49.566883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:49.567164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:49.567457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:49.578861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:49.580256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:49.595261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:49.599625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:49.600774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:49.600774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:49.600774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:49.600774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 617/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:49.602490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:49.693351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:49.699387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fca85-d244-41af-b713-6352d35e046f None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:49.732287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:49.732880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:49.733159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:49.733427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:49.734054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:49.734356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:49.735722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:49.747072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 626/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:49.753292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:49.834467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:49.854367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662841-6246-4884-a963-8089abc6bf33 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:49.886854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:49.887500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:49.887786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:49.888052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:49.894437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:49.895934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:33:49.906808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:49.912902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:49.914268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 618/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:49.916111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:50.015796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9bf0-c6d8-4497-8a84-f243fbb226ac None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:50.047228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa31b-c3d1-4de9-9748-1cb64c39412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:50.047852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa31b-c3d1-4de9-9748-1cb64c39412a None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:50.048132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa31b-c3d1-4de9-9748-1cb64c39412a None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:50.048405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa31b-c3d1-4de9-9748-1cb64c39412a None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:50.049084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aa31b-c3d1-4de9-9748-1cb64c39412a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:50.049389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aa31b-c3d1-4de9-9748-1cb64c39412a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:50.050809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3aa31b-c3d1-4de9-9748-1cb64c39412a None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:50.063251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 627/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:50.069612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:50.169961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859abc2-fcd9-49d1-a125-7320d243f121 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:50.202707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba61e67-e780-4c0f-8710-173b04697b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:50.203303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61e67-e780-4c0f-8710-173b04697b52 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:50.203606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61e67-e780-4c0f-8710-173b04697b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:50.203879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba61e67-e780-4c0f-8710-173b04697b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:50.204597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba61e67-e780-4c0f-8710-173b04697b52 None admin] RBAC: Adding query filter params (role.id=6288c02347fc4743b28fbb9e17d55542, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=4b79ca72535543aeac33b949189ee4da) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:50.204905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba61e67-e780-4c0f-8710-173b04697b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:50.206311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba61e67-e780-4c0f-8710-173b04697b52 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:50.212139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 619/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:33:50 2022] GET /identity/v3/role_assignments?user.id=4b79ca72535543aeac33b949189ee4da&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=6288c02347fc4743b28fbb9e17d55542 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:52.426750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b896a-d7ac-415b-a899-f4434a7915eb None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:52.427299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b896a-d7ac-415b-a899-f4434a7915eb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:52.427299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b896a-d7ac-415b-a899-f4434a7915eb None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:52.428648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 628/1247] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:33:52.433967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abdd70-0545-4b5c-8690-0395d56e235b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:52.434387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abdd70-0545-4b5c-8690-0395d56e235b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:52.434539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abdd70-0545-4b5c-8690-0395d56e235b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:52.440768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:52.453180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-94abdd70-0545-4b5c-8690-0395d56e235b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:33:52.454366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-94abdd70-0545-4b5c-8690-0395d56e235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:33:52.518867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 620/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:33:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:33:52.789693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b896a-d7ac-415b-a899-f4434a7915eb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:52.808107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:52.893956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b896a-d7ac-415b-a899-f4434a7915eb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:52.928894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:52.929583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:52.930877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:52.931162 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:52.941244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:33:52.947251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:52.951988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:52.954055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 629/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:52.955381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abdd70-0545-4b5c-8690-0395d56e235b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:53.049651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abdd70-0545-4b5c-8690-0395d56e235b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:53.078361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:53.082860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:53.083546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:53.083836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:53.084111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:53.084773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:53.085076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:53.086483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:53.094123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 621/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:33:53.100050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:53.177078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:53.199342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7058e0-7509-4516-a76f-acecb0c374f9 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:53.231338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:53.231980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:53.232257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:53.232528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:53.242057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:53.244256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:53.258601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:53.259692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:53.260690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:53.260690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:53.260690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:53.260690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 630/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:53.265540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:53.363699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69887-3c1b-45f8-99ba-4dc9f3cc02c7 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:53.396977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:53.397577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:53.397864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:53.398165 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:53.399282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:53.399617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:53.400965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:53.412248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 622/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:53.418492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:53.517422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa499a79-ef7b-4e0e-ae71-161314f023da None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:53.545189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:53.552813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:53.553422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:53.553700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:53.553970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:53.561207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:53.562619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:33:53.573699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:53.574838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:53.576185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 631/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:53.580645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:53.635263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:53.678399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0fcf-8ce1-4234-b8a2-1b63d48a0a26 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:53.710109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:53.710706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:53.711550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:53.711828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:53.712544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:53.712870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:53.714288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:53.730929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 623/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 28 08:33:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:53.736804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:53.838345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e70e4-235e-40fa-985a-088d4920f1d2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:53.872549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:53.873211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:53.873493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:53.873769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:53.931320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:53.943621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:53.945161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:54.045996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 632/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:33:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:33:54.051843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:54.149882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a6695-acc6-4d44-93e2-d03f70e26343 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:54.163024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:54.182904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:54.183486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:54.183767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:54.184035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:54.193638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:54.195062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:54.209701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:54.221202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:54.222338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:54.222338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:54.222338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:54.222338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 624/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:54.222616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:54.303025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:54.315363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d9193-1f82-4384-bbfc-e496d1e6a07e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:54.348500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:54.349130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:54.349412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:54.349682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:54.350315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:54.350616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:54.352382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:54.363146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 633/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:54.369651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:54.466392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fbe8b-6c4f-44b5-a282-7f01ac0c8e70 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:54.503634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:54.504255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:54.504535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:54.504805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:54.512076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:54.513495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:33:54.524547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:54.525654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:33:54.526754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 625/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:54.531462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:54.634407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f1d5-f734-4fe7-b6bb-f9169488c023 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:54.667931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370cca7-5d7b-4644-9934-ef42aeb5a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:54.668530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370cca7-5d7b-4644-9934-ef42aeb5a80c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:54.668808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370cca7-5d7b-4644-9934-ef42aeb5a80c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:54.669077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370cca7-5d7b-4644-9934-ef42aeb5a80c None admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:54.669755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370cca7-5d7b-4644-9934-ef42aeb5a80c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:54.670063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370cca7-5d7b-4644-9934-ef42aeb5a80c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:54.671499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370cca7-5d7b-4644-9934-ef42aeb5a80c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:54.683827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 634/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:54.690167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:54.714863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:54.785081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b89a-b0ad-4474-b25b-22581c3c6fe0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:54.817463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449ec79-aff1-4805-a7a8-21cef5ccf01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:54.818053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449ec79-aff1-4805-a7a8-21cef5ccf01e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:54.818329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449ec79-aff1-4805-a7a8-21cef5ccf01e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:54.818597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449ec79-aff1-4805-a7a8-21cef5ccf01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:54.819313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449ec79-aff1-4805-a7a8-21cef5ccf01e None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=4b79ca72535543aeac33b949189ee4da) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:54.819647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449ec79-aff1-4805-a7a8-21cef5ccf01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:54.821083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449ec79-aff1-4805-a7a8-21cef5ccf01e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:54.827003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 626/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:33:54 2022] GET /identity/v3/role_assignments?user.id=4b79ca72535543aeac33b949189ee4da&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=8b22e1c1112547309cda07f916d1a452 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:56.974321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d525c9-3344-4c1e-b279-ad38fa796903 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:56.974879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d525c9-3344-4c1e-b279-ad38fa796903 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:56.974879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d525c9-3344-4c1e-b279-ad38fa796903 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:56.976256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 635/1261] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:33:56.981496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675910e-74aa-4545-b351-cfead0d56bbf None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:56.981945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675910e-74aa-4545-b351-cfead0d56bbf None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:56.982046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675910e-74aa-4545-b351-cfead0d56bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:56.999900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0675910e-74aa-4545-b351-cfead0d56bbf None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:33:57.001061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0675910e-74aa-4545-b351-cfead0d56bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:33:57.065839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 627/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:33:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:33:57.347186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d525c9-3344-4c1e-b279-ad38fa796903 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:57.358906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:57.452545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d525c9-3344-4c1e-b279-ad38fa796903 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:57.486758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:57.487374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:57.487683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:57.487953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:57.498175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:33:57.502928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:57.504410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:57.505488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 636/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:57.510922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675910e-74aa-4545-b351-cfead0d56bbf None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:57.528972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:57.610124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675910e-74aa-4545-b351-cfead0d56bbf None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:57.648025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:57.649176 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:57.649450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:57.649715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:57.650370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:57.650666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:57.652044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:57.659737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 628/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:57.665681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:57.732116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:57.766570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f6d37-db60-48d4-ae14-6d0bb7fd523e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:57.799545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:57.800169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:57.800480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:57.800757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:57.811802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:57.813256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:57.828061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:57.829253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:57.830391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:57.830391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:57.830391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:57.830391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 637/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:57.835098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:57.917484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:57.936358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393eac5-b3b6-44f6-9e2b-93d5157f65ca None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:57.970279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:57.971077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:57.971558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:57.972231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:57.972880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:57.973185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:57.974550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:57.985994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 629/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:57.991763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:58.094921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f94331-132d-4cba-ad06-ed160db3d4c2 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:58.113815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:58.127498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:58.128117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:58.128644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:58.128913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:58.136579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:58.138009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:33:58.148841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:58.150005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:58.151363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 638/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:58.155746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:58.254390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c9d2-2603-4584-8209-3c7d96e3a063 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:58.286952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:58.287588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:58.287869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:58.288141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:58.288890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:58.289198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:58.290612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:58.299278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:58.307540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 630/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 28 08:33:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:58.313649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:58.413692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab3843-b7a0-4404-8fce-38a6336dd424 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:58.447533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:58.448175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:58.448437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:58.448713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:58.459036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:58.460520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:33:58.474342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:58.475369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:33:58.477280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:33:58.477280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:33:58.477280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:58.477280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 639/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:58.482017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:58.580435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7f5c6-b157-442d-a5cc-fd0d39ea34a8 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:58.613278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:58.613875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:58.614158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:58.614431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:58.615066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:58.615367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:58.616748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:58.628659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 631/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:58.634447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:58.666868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:58.734998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afb59a-e1a0-4d9e-acd2-741e7f86a8b8 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:58.768327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:58.768971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:58.769250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:58.769520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:58.776479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:58.777920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:33:58.789525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:33:58.790712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:33:58.791717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 640/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:33:58.796553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:58.853952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:58.892815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4a2e-e31a-4166-ae22-a2858b11a5e6 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:58.925974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197275-b38f-442d-b4b5-6dd23c4bfcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:58.926580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197275-b38f-442d-b4b5-6dd23c4bfcda None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:58.926860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197275-b38f-442d-b4b5-6dd23c4bfcda None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:58.927131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197275-b38f-442d-b4b5-6dd23c4bfcda None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:58.927863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197275-b38f-442d-b4b5-6dd23c4bfcda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:33:58.928172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197275-b38f-442d-b4b5-6dd23c4bfcda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:58.929695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197275-b38f-442d-b4b5-6dd23c4bfcda None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:58.941592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 632/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:33:58.947442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:33:59.035973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:59.045212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfb8e6-33c8-4667-8ced-3b8f4a9b1811 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:33:59.080452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dbab7-3822-47f9-be34-fe4623a3e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:33:59.081317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dbab7-3822-47f9-be34-fe4623a3e2d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:33:59.081590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dbab7-3822-47f9-be34-fe4623a3e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:33:59.081857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dbab7-3822-47f9-be34-fe4623a3e2d9 None admin] PATH_INFO: `/v3/projects/b91e255418634b46b675b95be1320ec9/users/4b79ca72535543aeac33b949189ee4da/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:33:59.083740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dbab7-3822-47f9-be34-fe4623a3e2d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b91e255418634b46b675b95be1320ec9, user_id=4b79ca72535543aeac33b949189ee4da, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:33:59.085165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dbab7-3822-47f9-be34-fe4623a3e2d9 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:33:59.234335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 641/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 28 08:33:58 2022] PUT /identity/v3/projects/b91e255418634b46b675b95be1320ec9/users/4b79ca72535543aeac33b949189ee4da/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:34:01.504658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d0a0-500a-4fc2-bb93-e8ed15319b6b None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:01.505208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d0a0-500a-4fc2-bb93-e8ed15319b6b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:01.505401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d0a0-500a-4fc2-bb93-e8ed15319b6b None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:01.506829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 633/1274] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:34:01.512132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584ff5-f224-4a5e-b52f-995bcf42805d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:01.512519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584ff5-f224-4a5e-b52f-995bcf42805d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:01.512717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd584ff5-f224-4a5e-b52f-995bcf42805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:01.530801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fd584ff5-f224-4a5e-b52f-995bcf42805d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:34:01.531998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fd584ff5-f224-4a5e-b52f-995bcf42805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:34:01.598874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 642/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:34:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:34:01.875130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25d0a0-500a-4fc2-bb93-e8ed15319b6b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:01.974773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25d0a0-500a-4fc2-bb93-e8ed15319b6b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:01.992632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:02.009530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:02.010158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:02.010441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:02.010714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:02.020662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 28 08:34:02.026595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:02.027774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:02.028973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 634/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 28 08:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:02.033820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd584ff5-f224-4a5e-b52f-995bcf42805d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:02.114357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:02.132173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd584ff5-f224-4a5e-b52f-995bcf42805d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:02.166122 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:02.166728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:02.167011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:02.167287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:02.167985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:02.168291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:02.169652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:02.177478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 643/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 28 08:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:02.183686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:02.283306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271e28-9539-46a4-a086-b5972686e0c3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:02.316292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:02.316911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:02.317193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:02.317467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:02.327941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:02.329381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:34:02.344258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:02.348969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:34:02.350087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:34:02.350087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:34:02.350087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:02.350087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 635/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:02.351392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:02.450562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f980-4579-4291-9692-49ef860aa272 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:02.483643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:02.484236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:02.484515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:02.484787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:02.485421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:02.485719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:02.487077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:02.498958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 644/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:02.505086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:02.535645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:02.602575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d2b1e-e312-4e0d-91c6-c2c95d1310c3 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:02.636195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:02.636820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:02.637104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:02.637380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:02.644088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:02.648869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 28 08:34:02.658073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:02.659024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:02.660134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 636/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:34:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:02.665294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:02.669096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:02.764208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5476cf-2951-425e-bb80-07db3276916e None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:02.797534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:02.798830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:02.798830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:02.798830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:02.799400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:02.800108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:02.801231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:02.819938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 645/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 28 08:34:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:02.826864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:02.917729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:02.927063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483f6b-cbb1-4f2d-a0b8-639e03a43282 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:02.960853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:02.961455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:02.961736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:02.962008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:03.029273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:03.030645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:03.114556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:03.124228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 637/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 28 08:34:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 28 08:34:03.130381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:03.190787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:03.229380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca904a3-5e35-4703-8543-8dfd80fc14ba None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:03.263647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:03.264313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:03.264595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:03.264869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:03.275091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:03.276602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 28 08:34:03.296359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:03.297552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 28 08:34:03.298483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 28 08:34:03.298483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 28 08:34:03.298483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:34:03.298483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 646/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:03.298737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:03.399187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f29b93-acea-4f59-82c6-2d2c2ebeddad None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:03.431943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:03.432545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:03.432829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:03.433100 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:03.433735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:03.434038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:03.435377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:03.446971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 638/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 28 08:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:03.452760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:03.552111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3268b2-42a2-4d7e-aff1-a80669eb616c None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:03.566288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:03.585946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:03.586687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:03.587007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:03.587227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:03.593764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:03.595179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 28 08:34:03.606785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:03.610814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: ERROR keystone.server.flask.application Sep 28 08:34:03.612002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 647/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 28 08:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:03.613851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:03.665899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:03.714861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ad67c-1903-4226-b7e1-3344e6b3486e None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:03.749754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb81552-f9ee-4489-a8f8-1d82b81712b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:03.750366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb81552-f9ee-4489-a8f8-1d82b81712b2 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:03.750651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb81552-f9ee-4489-a8f8-1d82b81712b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:03.750910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb81552-f9ee-4489-a8f8-1d82b81712b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:03.751627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb81552-f9ee-4489-a8f8-1d82b81712b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:03.751935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb81552-f9ee-4489-a8f8-1d82b81712b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:03.753646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb81552-f9ee-4489-a8f8-1d82b81712b2 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:03.765988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 639/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 28 08:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:03.772306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:03.872258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deffd8-43f3-4a86-9120-dd353af3c725 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:03.908675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446006-2270-4b8d-8252-a0c0e74c2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:03.909275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446006-2270-4b8d-8252-a0c0e74c2f75 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:03.909549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446006-2270-4b8d-8252-a0c0e74c2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:03.909816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446006-2270-4b8d-8252-a0c0e74c2f75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:03.910532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de446006-2270-4b8d-8252-a0c0e74c2f75 None admin] RBAC: Adding query filter params (role.id=8b22e1c1112547309cda07f916d1a452, scope.project.id=b91e255418634b46b675b95be1320ec9, user.id=4b79ca72535543aeac33b949189ee4da) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:03.910837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de446006-2270-4b8d-8252-a0c0e74c2f75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:03.912303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de446006-2270-4b8d-8252-a0c0e74c2f75 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:03.919053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 648/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 28 08:34:03 2022] GET /identity/v3/role_assignments?user.id=4b79ca72535543aeac33b949189ee4da&scope.project.id=b91e255418634b46b675b95be1320ec9&role.id=8b22e1c1112547309cda07f916d1a452 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:06.094909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7677a8-f762-4ba0-b25b-7e8f1b50b86b None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:06.095443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7677a8-f762-4ba0-b25b-7e8f1b50b86b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:06.095553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7677a8-f762-4ba0-b25b-7e8f1b50b86b None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:06.096907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 640/1288] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:34:06.102786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88823c-177a-428e-800d-a00e676be8b4 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:06.103182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88823c-177a-428e-800d-a00e676be8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:06.103328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88823c-177a-428e-800d-a00e676be8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:06.121689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9f88823c-177a-428e-800d-a00e676be8b4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:34:06.122866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9f88823c-177a-428e-800d-a00e676be8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:34:06.151730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:06.187949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 649/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:34:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:34:06.454086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7677a8-f762-4ba0-b25b-7e8f1b50b86b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:06.553808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7677a8-f762-4ba0-b25b-7e8f1b50b86b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:06.563989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:06.587158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:06.587804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:06.588083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:06.588355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] PATH_INFO: `/v3/services/placement` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:06.588927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:06.590282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:06.598732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:06.600003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:06.600955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 641/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:34:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:06.605833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88823c-177a-428e-800d-a00e676be8b4 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:06.705183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88823c-177a-428e-800d-a00e676be8b4 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:06.738599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c720-3ffa-4327-ad90-4a71ba9e64ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:06.739202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c720-3ffa-4327-ad90-4a71ba9e64ff None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:06.739508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c720-3ffa-4327-ad90-4a71ba9e64ff None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:06.739785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c720-3ffa-4327-ad90-4a71ba9e64ff None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:06.740413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c720-3ffa-4327-ad90-4a71ba9e64ff None admin] RBAC: Adding query filter params (name=placement) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:06.740713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c720-3ffa-4327-ad90-4a71ba9e64ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:06.742114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c720-3ffa-4327-ad90-4a71ba9e64ff None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:06.746816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 650/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 28 08:34:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:06.752709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:06.854876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d47a6-5236-4015-89af-5f31ac10afcf None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:06.889461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77cb07-cb7e-48c3-a9c0-043af1f14512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:06.890094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77cb07-cb7e-48c3-a9c0-043af1f14512 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:06.890372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77cb07-cb7e-48c3-a9c0-043af1f14512 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:06.890645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77cb07-cb7e-48c3-a9c0-043af1f14512 None admin] PATH_INFO: `/v3/services` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:06.891291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77cb07-cb7e-48c3-a9c0-043af1f14512 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:06.891622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77cb07-cb7e-48c3-a9c0-043af1f14512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:06.892973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77cb07-cb7e-48c3-a9c0-043af1f14512 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:06.897448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 642/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 28 08:34:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:09.031850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bea893-01dd-4736-bb53-2163ea926821 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:09.032382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bea893-01dd-4736-bb53-2163ea926821 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:09.032382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bea893-01dd-4736-bb53-2163ea926821 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:09.033792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 651/1293] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:34:09.039635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5afed5-7dd6-4ffb-8278-fca44c1e210e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:09.040043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5afed5-7dd6-4ffb-8278-fca44c1e210e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:09.040157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5afed5-7dd6-4ffb-8278-fca44c1e210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:09.058501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7f5afed5-7dd6-4ffb-8278-fca44c1e210e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:34:09.059714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7f5afed5-7dd6-4ffb-8278-fca44c1e210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:34:09.088568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:09.124952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 643/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:34:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:34:09.395902 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bea893-01dd-4736-bb53-2163ea926821 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:09.426322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:09.500558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bea893-01dd-4736-bb53-2163ea926821 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:09.535260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0369a-4849-45e3-a420-14a03ee87858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:09.535889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0369a-4849-45e3-a420-14a03ee87858 None admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:09.536172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0369a-4849-45e3-a420-14a03ee87858 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:09.536446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0369a-4849-45e3-a420-14a03ee87858 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:09.537099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0369a-4849-45e3-a420-14a03ee87858 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:09.538911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0369a-4849-45e3-a420-14a03ee87858 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:09.616276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 652/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 28 08:34:09 2022] POST /identity/v3/services => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:34:11.773022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a2d20-39a0-4fc3-a30a-8ccde0e9f83a None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:11.773720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a2d20-39a0-4fc3-a30a-8ccde0e9f83a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:11.773720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a2d20-39a0-4fc3-a30a-8ccde0e9f83a None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:11.774949 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 644/1296] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:34:11.780469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b34da2-bf79-40fc-b913-c796f552b5c7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:11.781030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b34da2-bf79-40fc-b913-c796f552b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:11.781030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b34da2-bf79-40fc-b913-c796f552b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:11.799152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-86b34da2-bf79-40fc-b913-c796f552b5c7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:34:11.800341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-86b34da2-bf79-40fc-b913-c796f552b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:34:11.874264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 653/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:34:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:34:12.144193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a2d20-39a0-4fc3-a30a-8ccde0e9f83a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:12.247285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a2d20-39a0-4fc3-a30a-8ccde0e9f83a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:12.280804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:12.281428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:12.281710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:12.281988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:12.282568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:12.284010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:12.293345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:12.296402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:12.297270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 645/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:34:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:12.301009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b34da2-bf79-40fc-b913-c796f552b5c7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:12.319253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:12.401293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b34da2-bf79-40fc-b913-c796f552b5c7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:12.434336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:12.434936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:12.435282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:12.435583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:12.436202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:12.436499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:12.437893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:12.442948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 654/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 28 08:34:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:12.449837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:12.480889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:12.549986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919351f-9c4b-47f2-9b37-fc0ad6886291 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:12.585649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12e30a-9dbe-4707-85c7-703ff5729ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:12.586570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e30a-9dbe-4707-85c7-703ff5729ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:12.587002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e30a-9dbe-4707-85c7-703ff5729ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:12.587314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e30a-9dbe-4707-85c7-703ff5729ad7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:12.588056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12e30a-9dbe-4707-85c7-703ff5729ad7 None admin] RBAC: Adding query filter params (interface=public, service_id=f34b3548650b4af589901b34ada87616, region_id=RegionOne) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:12.590322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12e30a-9dbe-4707-85c7-703ff5729ad7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:12.590322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12e30a-9dbe-4707-85c7-703ff5729ad7 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:12.595820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 646/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 28 08:34:12 2022] GET /identity/v3/endpoints?service_id=f34b3548650b4af589901b34ada87616&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:12.602148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:12.686605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:12.704550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa0344-18b2-4eea-ad44-e316a5b73962 None admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:12.738677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e56494-aab9-462b-854d-9a31995333a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:12.739285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56494-aab9-462b-854d-9a31995333a8 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:12.739602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56494-aab9-462b-854d-9a31995333a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:12.739883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e56494-aab9-462b-854d-9a31995333a8 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:12.740529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e56494-aab9-462b-854d-9a31995333a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:12.742704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e56494-aab9-462b-854d-9a31995333a8 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:12.749535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 655/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 28 08:34:12 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:34:14.895192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9cd5-df5c-4635-94f8-2cbd5d15ef2c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:14.895759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9cd5-df5c-4635-94f8-2cbd5d15ef2c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:14.895759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9cd5-df5c-4635-94f8-2cbd5d15ef2c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:14.897101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 647/1302] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:34:14.902363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316bab-6ff4-465c-87c9-8c92add687c5 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:14.902740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316bab-6ff4-465c-87c9-8c92add687c5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:14.902910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316bab-6ff4-465c-87c9-8c92add687c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:14.922393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ff316bab-6ff4-465c-87c9-8c92add687c5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:34:14.923651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ff316bab-6ff4-465c-87c9-8c92add687c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:34:14.990983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 656/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:34:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 28 08:34:15.260333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d9cd5-df5c-4635-94f8-2cbd5d15ef2c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:15.351792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:15.358478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d9cd5-df5c-4635-94f8-2cbd5d15ef2c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:15.391524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:15.392150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:15.392423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:15.392689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:15.393263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:15.394617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 28 08:34:15.403754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 28 08:34:15.415455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.get_or_create( Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application with Lock( Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self._enter() Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application return self.creator() Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application created_value = creator( Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: ERROR keystone.server.flask.application Sep 28 08:34:15.416524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 648/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 28 08:34:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 28 08:34:15.417544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316bab-6ff4-465c-87c9-8c92add687c5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:15.485343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:15.508842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316bab-6ff4-465c-87c9-8c92add687c5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:15.541888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e61270-0f84-49b3-a7ea-f554932e4322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:15.542427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e61270-0f84-49b3-a7ea-f554932e4322 None admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:15.542706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e61270-0f84-49b3-a7ea-f554932e4322 None admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:15.542978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e61270-0f84-49b3-a7ea-f554932e4322 None admin] PATH_INFO: `/v3/services` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:15.543626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e61270-0f84-49b3-a7ea-f554932e4322 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:34:15.543929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e61270-0f84-49b3-a7ea-f554932e4322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:15.545279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e61270-0f84-49b3-a7ea-f554932e4322 None admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:15.550348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 657/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 28 08:34:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:34:15.557272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:34:15.653638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdb85d-97c3-4a61-9604-e3da7ba867a0 None admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:34:15.686686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5e8bf-e74a-4f17-ab98-73e1a3dc6e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:34:15.687280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e8bf-e74a-4f17-ab98-73e1a3dc6e99 None admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:34:15.687596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e8bf-e74a-4f17-ab98-73e1a3dc6e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:34:15.687868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5e8bf-e74a-4f17-ab98-73e1a3dc6e99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:34:15.688528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e8bf-e74a-4f17-ab98-73e1a3dc6e99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:34:15.689858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5e8bf-e74a-4f17-ab98-73e1a3dc6e99 None admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:34:15.753463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 649/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:34:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:34:25.553258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=30 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:34:25.748819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:37.822528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf404d-1c79-48ef-96a6-fdd4f92784b0 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:37.823070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf404d-1c79-48ef-96a6-fdd4f92784b0 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:37.823070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf404d-1c79-48ef-96a6-fdd4f92784b0 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:37.824532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 658/1307] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:40:37.829714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29596276-1ddd-4827-b84e-86acd2bb923a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:37.830154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29596276-1ddd-4827-b84e-86acd2bb923a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:37.830235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29596276-1ddd-4827-b84e-86acd2bb923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:37.925009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-29596276-1ddd-4827-b84e-86acd2bb923a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:37.926508 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-29596276-1ddd-4827-b84e-86acd2bb923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:38.044712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 650/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:40:38.339673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b646d80-c147-4e51-9461-40db78622b3f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:38.342197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b646d80-c147-4e51-9461-40db78622b3f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:38.342197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b646d80-c147-4e51-9461-40db78622b3f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:38.342197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 659/1309] 10.222.0.57 () {54 vars in 964 bytes} [Wed Sep 28 08:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:40:38.348329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ced5-5ad1-4684-895d-fbc116a20aa3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:38.348684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ced5-5ad1-4684-895d-fbc116a20aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:38.349030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051ced5-5ad1-4684-895d-fbc116a20aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:38.435097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7051ced5-5ad1-4684-895d-fbc116a20aa3 None None] MFA Rules not processed for user `5523644021bf4d91a3a9246bee763b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:38.436332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7051ced5-5ad1-4684-895d-fbc116a20aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:38.458094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:38.516717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 651/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Wed Sep 28 08:40:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:40:38.525557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b646d80-c147-4e51-9461-40db78622b3f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:40:38.527269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1b646d80-c147-4e51-9461-40db78622b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:38.640641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b646d80-c147-4e51-9461-40db78622b3f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:40:38.717874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe63a8-8427-4003-8909-dc60777ef4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:40:38.718961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe63a8-8427-4003-8909-dc60777ef4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:38.719236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe63a8-8427-4003-8909-dc60777ef4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:38.719532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe63a8-8427-4003-8909-dc60777ef4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:38.721099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6dbe63a8-8427-4003-8909-dc60777ef4c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:38.778174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:38.836528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe63a8-8427-4003-8909-dc60777ef4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:40:38.837965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe63a8-8427-4003-8909-dc60777ef4c8 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:40:38.857449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 660/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:40:41.325990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b95ca6-ffe2-4c7d-8311-f9938dee9f6a None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:41.326538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b95ca6-ffe2-4c7d-8311-f9938dee9f6a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:41.326538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b95ca6-ffe2-4c7d-8311-f9938dee9f6a None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:41.328650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 652/1312] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:40:41.333839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef28e03-8d46-4a09-ac5c-a72b9a1a06df None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:41.334239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef28e03-8d46-4a09-ac5c-a72b9a1a06df None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:41.334389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef28e03-8d46-4a09-ac5c-a72b9a1a06df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:41.404626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9ef28e03-8d46-4a09-ac5c-a72b9a1a06df None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:41.406322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9ef28e03-8d46-4a09-ac5c-a72b9a1a06df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:41.502577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 661/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:40:41.784133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b95ca6-ffe2-4c7d-8311-f9938dee9f6a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:40:41.785659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-19b95ca6-ffe2-4c7d-8311-f9938dee9f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:41.895174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b95ca6-ffe2-4c7d-8311-f9938dee9f6a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:40:41.977552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:41.979886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbb7e5-2b09-4c01-b00f-bd8c6952696c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:40:41.980498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb7e5-2b09-4c01-b00f-bd8c6952696c service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:41.980781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb7e5-2b09-4c01-b00f-bd8c6952696c service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:41.981052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb7e5-2b09-4c01-b00f-bd8c6952696c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:41.982645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e0dbb7e5-2b09-4c01-b00f-bd8c6952696c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:42.092322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbb7e5-2b09-4c01-b00f-bd8c6952696c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:40:42.093791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbb7e5-2b09-4c01-b00f-bd8c6952696c service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:40:42.111676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 653/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:40:44.748047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97d9f-d9c1-4530-a3dd-14777343fb85 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:44.748613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97d9f-d9c1-4530-a3dd-14777343fb85 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:44.748613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e97d9f-d9c1-4530-a3dd-14777343fb85 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:44.750054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 662/1315] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:40:44.755216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e3a22-a966-4d14-992c-99961013e3dc None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:44.755620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e3a22-a966-4d14-992c-99961013e3dc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:44.755818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e3a22-a966-4d14-992c-99961013e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:44.821994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ce4e3a22-a966-4d14-992c-99961013e3dc None None] MFA Rules not processed for user `7c7828409b6d44438fbb82bf8a9c104d`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:44.823199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ce4e3a22-a966-4d14-992c-99961013e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:44.874958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:44.920035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 654/1316] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:40:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:40:45.225052 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e97d9f-d9c1-4530-a3dd-14777343fb85 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:40:45.226610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f2e97d9f-d9c1-4530-a3dd-14777343fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:45.236952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:45.329665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e97d9f-d9c1-4530-a3dd-14777343fb85 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:40:45.404436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc140158-e2d4-4abf-95e2-bdabc2e3cb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:40:45.405035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140158-e2d4-4abf-95e2-bdabc2e3cb83 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:45.405366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140158-e2d4-4abf-95e2-bdabc2e3cb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:45.405640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc140158-e2d4-4abf-95e2-bdabc2e3cb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:45.407226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-bc140158-e2d4-4abf-95e2-bdabc2e3cb83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:45.469370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:45.522634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc140158-e2d4-4abf-95e2-bdabc2e3cb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:40:45.524119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc140158-e2d4-4abf-95e2-bdabc2e3cb83 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:40:45.542287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 663/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:40:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:40:48.451342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7848c-04a3-4430-9896-b1fb2ae40a14 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:48.451899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7848c-04a3-4430-9896-b1fb2ae40a14 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:48.451899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7848c-04a3-4430-9896-b1fb2ae40a14 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:48.453874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 655/1318] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:40:48.459012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd423e-6517-4197-be6a-2358803416d8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:48.459436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd423e-6517-4197-be6a-2358803416d8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:48.459612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd423e-6517-4197-be6a-2358803416d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:48.524490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-90bd423e-6517-4197-be6a-2358803416d8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:48.525689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-90bd423e-6517-4197-be6a-2358803416d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:48.621023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 664/1319] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:40:48.901830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7848c-04a3-4430-9896-b1fb2ae40a14 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:40:48.903363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-28a7848c-04a3-4430-9896-b1fb2ae40a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:49.007981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7848c-04a3-4430-9896-b1fb2ae40a14 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:40:49.081769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10110-10ab-441f-8d96-39b3f3520175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:40:49.082310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10110-10ab-441f-8d96-39b3f3520175 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:49.082593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10110-10ab-441f-8d96-39b3f3520175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:49.082866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10110-10ab-441f-8d96-39b3f3520175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:49.084494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-64e10110-10ab-441f-8d96-39b3f3520175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:49.091209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:49.193720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e10110-10ab-441f-8d96-39b3f3520175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:40:49.195138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e10110-10ab-441f-8d96-39b3f3520175 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:40:49.212772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 656/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:40:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:40:52.579317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe7914-e96d-4e30-b555-3d537d259de9 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:52.579916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe7914-e96d-4e30-b555-3d537d259de9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:52.579916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe7914-e96d-4e30-b555-3d537d259de9 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:52.581268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 665/1321] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:40:52.586593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3aa7-d5bd-406f-b095-4ce1234baf93 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:52.587046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3aa7-d5bd-406f-b095-4ce1234baf93 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:52.587141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3aa7-d5bd-406f-b095-4ce1234baf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:52.659274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-559b3aa7-d5bd-406f-b095-4ce1234baf93 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:52.660554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-559b3aa7-d5bd-406f-b095-4ce1234baf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:52.721937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:52.764563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 657/1322] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:40:53.047230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe7914-e96d-4e30-b555-3d537d259de9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:40:53.048845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8cbe7914-e96d-4e30-b555-3d537d259de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:53.068606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:53.153388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe7914-e96d-4e30-b555-3d537d259de9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:40:53.226517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd83f-9468-409e-ae4a-53ae60bc527f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:40:53.227117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd83f-9468-409e-ae4a-53ae60bc527f service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:53.227397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd83f-9468-409e-ae4a-53ae60bc527f service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:53.227701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd83f-9468-409e-ae4a-53ae60bc527f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:53.229281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-146dd83f-9468-409e-ae4a-53ae60bc527f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:53.300594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:53.339464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd83f-9468-409e-ae4a-53ae60bc527f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:40:53.340903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd83f-9468-409e-ae4a-53ae60bc527f service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:40:53.360818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 666/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:40:55.601038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bc0cc-f64c-4288-8464-a110a87d29ec None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:55.601559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bc0cc-f64c-4288-8464-a110a87d29ec None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:55.601559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bc0cc-f64c-4288-8464-a110a87d29ec None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:55.602947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 658/1324] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:40:55.608348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dba4e-47d8-481c-a956-efdea24a0540 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:55.608748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dba4e-47d8-481c-a956-efdea24a0540 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:55.609002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dba4e-47d8-481c-a956-efdea24a0540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:55.674731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-842dba4e-47d8-481c-a956-efdea24a0540 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:55.676015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-842dba4e-47d8-481c-a956-efdea24a0540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:55.782983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 667/1325] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:40:56.069709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bc0cc-f64c-4288-8464-a110a87d29ec None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:40:56.071348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-292bc0cc-f64c-4288-8464-a110a87d29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:56.175207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bc0cc-f64c-4288-8464-a110a87d29ec None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:40:56.250124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e36ac-b836-44eb-a3db-d8c4345e826b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:40:56.250726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e36ac-b836-44eb-a3db-d8c4345e826b service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:56.251003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e36ac-b836-44eb-a3db-d8c4345e826b service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:56.251660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e36ac-b836-44eb-a3db-d8c4345e826b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:56.253246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5f6e36ac-b836-44eb-a3db-d8c4345e826b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:56.271642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:56.365933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e36ac-b836-44eb-a3db-d8c4345e826b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:40:56.367555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e36ac-b836-44eb-a3db-d8c4345e826b service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:40:56.386763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 659/1326] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:40:58.665309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4ae5-3080-4f95-8894-dae4abbda61c None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:58.665763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4ae5-3080-4f95-8894-dae4abbda61c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:58.665852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec4ae5-3080-4f95-8894-dae4abbda61c None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:58.667215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 668/1327] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:40:58.673036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffe9bd-e0fe-4fad-baca-e9323f87d058 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:58.673485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffe9bd-e0fe-4fad-baca-e9323f87d058 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:58.673581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffe9bd-e0fe-4fad-baca-e9323f87d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:58.738915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-27ffe9bd-e0fe-4fad-baca-e9323f87d058 None None] MFA Rules not processed for user `7c7828409b6d44438fbb82bf8a9c104d`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:40:58.740140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-27ffe9bd-e0fe-4fad-baca-e9323f87d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:58.803727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:58.835999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 660/1328] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:40:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:40:59.132505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4ae5-3080-4f95-8894-dae4abbda61c None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:40:59.134371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1bec4ae5-3080-4f95-8894-dae4abbda61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:59.170565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:59.245850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec4ae5-3080-4f95-8894-dae4abbda61c None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:40:59.329560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8a9de-bd24-4965-a381-a8838a265759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:40:59.330161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a9de-bd24-4965-a381-a8838a265759 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:40:59.330437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a9de-bd24-4965-a381-a8838a265759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:40:59.330710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a9de-bd24-4965-a381-a8838a265759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:40:59.332326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-30a8a9de-bd24-4965-a381-a8838a265759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:40:59.410806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:59.442176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8a9de-bd24-4965-a381-a8838a265759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:40:59.443568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8a9de-bd24-4965-a381-a8838a265759 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:40:59.462307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 669/1329] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:40:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:02.052101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043300-bc1a-4f80-aa54-a2d0bcfab2b6 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:02.052650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043300-bc1a-4f80-aa54-a2d0bcfab2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:02.052650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3043300-bc1a-4f80-aa54-a2d0bcfab2b6 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:02.053993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 661/1330] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:02.059244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b0502-1f46-4c42-a09f-212e571be13e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:02.059715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b0502-1f46-4c42-a09f-212e571be13e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:02.059852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b0502-1f46-4c42-a09f-212e571be13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:02.126977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-be8b0502-1f46-4c42-a09f-212e571be13e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:02.128210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-be8b0502-1f46-4c42-a09f-212e571be13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:02.224098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 670/1331] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:02.508142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3043300-bc1a-4f80-aa54-a2d0bcfab2b6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:02.509672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f3043300-bc1a-4f80-aa54-a2d0bcfab2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:02.611466 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3043300-bc1a-4f80-aa54-a2d0bcfab2b6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:02.684278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda03061-4b65-4e97-a8d5-8336686d3ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:02.684871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03061-4b65-4e97-a8d5-8336686d3ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:02.685146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03061-4b65-4e97-a8d5-8336686d3ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:02.685415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda03061-4b65-4e97-a8d5-8336686d3ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:02.687034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-dda03061-4b65-4e97-a8d5-8336686d3ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:02.713434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:02.792441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda03061-4b65-4e97-a8d5-8336686d3ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:02.793853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda03061-4b65-4e97-a8d5-8336686d3ea9 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:02.812205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 662/1332] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:05.125620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb61c6-a524-4d9f-bd66-60da2e36175d None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:05.126132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb61c6-a524-4d9f-bd66-60da2e36175d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:05.126132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb61c6-a524-4d9f-bd66-60da2e36175d None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:05.127478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 671/1333] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:05.132834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f7f60-9c72-474c-a1d9-91a704823437 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:05.133266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f7f60-9c72-474c-a1d9-91a704823437 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:05.133361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f7f60-9c72-474c-a1d9-91a704823437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:05.197750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5d7f7f60-9c72-474c-a1d9-91a704823437 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:05.198936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5d7f7f60-9c72-474c-a1d9-91a704823437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:05.273011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:05.294454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 663/1334] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:05.613160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f831ca-c1d6-4f2b-a57d-23a28e506029 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:05.613445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f831ca-c1d6-4f2b-a57d-23a28e506029 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:05.613718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f831ca-c1d6-4f2b-a57d-23a28e506029 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:05.615063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 672/1335] 10.222.0.57 () {54 vars in 964 bytes} [Wed Sep 28 08:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:05.621347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45300128-dda3-436a-b40e-ae23854b6f3f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:05.621638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45300128-dda3-436a-b40e-ae23854b6f3f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:05.621908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45300128-dda3-436a-b40e-ae23854b6f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:05.699441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-45300128-dda3-436a-b40e-ae23854b6f3f None None] MFA Rules not processed for user `5523644021bf4d91a3a9246bee763b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:05.700773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-45300128-dda3-436a-b40e-ae23854b6f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:05.777150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 664/1336] 10.222.0.57 () {58 vars in 1061 bytes} [Wed Sep 28 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:05.786919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f831ca-c1d6-4f2b-a57d-23a28e506029 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:05.788456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-19f831ca-c1d6-4f2b-a57d-23a28e506029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:05.833425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:05.897664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f831ca-c1d6-4f2b-a57d-23a28e506029 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:05.971928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b51d-c306-4e52-b5ec-459f698bf9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:05.972536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b51d-c306-4e52-b5ec-459f698bf9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:05.972820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b51d-c306-4e52-b5ec-459f698bf9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:05.973098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b51d-c306-4e52-b5ec-459f698bf9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:05.974697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5979b51d-c306-4e52-b5ec-459f698bf9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:06.058494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:06.085032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b51d-c306-4e52-b5ec-459f698bf9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:06.086470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b51d-c306-4e52-b5ec-459f698bf9e7 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:06.104634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 673/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:09.301016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661916-f721-4444-ac94-c882769f7f36 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:09.301582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661916-f721-4444-ac94-c882769f7f36 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:09.301582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5661916-f721-4444-ac94-c882769f7f36 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:09.302891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 665/1338] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:09.308080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a7b1-6a3e-4ba7-9016-15aedec2f160 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:09.308511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a7b1-6a3e-4ba7-9016-15aedec2f160 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:09.308621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6a7b1-6a3e-4ba7-9016-15aedec2f160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:09.374924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-65e6a7b1-6a3e-4ba7-9016-15aedec2f160 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:09.376166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-65e6a7b1-6a3e-4ba7-9016-15aedec2f160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:09.473009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 674/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:09.756407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5661916-f721-4444-ac94-c882769f7f36 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:09.757939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b5661916-f721-4444-ac94-c882769f7f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:09.835272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:09.862309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5661916-f721-4444-ac94-c882769f7f36 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:09.937258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35a851-d791-48c3-8cac-cdb76e0a5845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:09.937867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a851-d791-48c3-8cac-cdb76e0a5845 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:09.938147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a851-d791-48c3-8cac-cdb76e0a5845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:09.938418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a851-d791-48c3-8cac-cdb76e0a5845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:09.940067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fe35a851-d791-48c3-8cac-cdb76e0a5845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:10.051462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35a851-d791-48c3-8cac-cdb76e0a5845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:10.052889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35a851-d791-48c3-8cac-cdb76e0a5845 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:10.071243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 666/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:14.403747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d6b8-3c3f-4996-a29e-379a790bea01 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:14.404259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d6b8-3c3f-4996-a29e-379a790bea01 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:14.404377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d6b8-3c3f-4996-a29e-379a790bea01 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:14.405730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 675/1341] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:14.411300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7d4dd-2365-43e3-a5de-07452162a2c5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:14.411830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7d4dd-2365-43e3-a5de-07452162a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:14.411921 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7d4dd-2365-43e3-a5de-07452162a2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:14.417913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:14.488057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d4f7d4dd-2365-43e3-a5de-07452162a2c5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:14.489372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d4f7d4dd-2365-43e3-a5de-07452162a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:14.591127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 667/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:14.879447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7d6b8-3c3f-4996-a29e-379a790bea01 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:14.880997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-97b7d6b8-3c3f-4996-a29e-379a790bea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:14.932535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:14.988776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7d6b8-3c3f-4996-a29e-379a790bea01 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:15.066033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7b962-1283-4f11-b028-9052bfde52df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:15.066643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7b962-1283-4f11-b028-9052bfde52df service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:15.066917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7b962-1283-4f11-b028-9052bfde52df service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:15.067183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7b962-1283-4f11-b028-9052bfde52df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:15.068779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-78e7b962-1283-4f11-b028-9052bfde52df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:15.164299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:15.180463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7b962-1283-4f11-b028-9052bfde52df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:15.181894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7b962-1283-4f11-b028-9052bfde52df service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:15.200144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 676/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:18.391902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dfccf-0cd5-41b1-949c-2fc2df440a55 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:18.392448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dfccf-0cd5-41b1-949c-2fc2df440a55 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:18.392731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dfccf-0cd5-41b1-949c-2fc2df440a55 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:18.394138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 668/1344] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:18.400191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a160-9cea-406b-bbf8-d348b731c262 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:18.400740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a160-9cea-406b-bbf8-d348b731c262 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:18.400868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a160-9cea-406b-bbf8-d348b731c262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:18.470995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-3742a160-9cea-406b-bbf8-d348b731c262 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:18.472247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3742a160-9cea-406b-bbf8-d348b731c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:18.571519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 677/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:18.859436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dfccf-0cd5-41b1-949c-2fc2df440a55 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:18.860975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ac1dfccf-0cd5-41b1-949c-2fc2df440a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:19.070400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:19.092865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dfccf-0cd5-41b1-949c-2fc2df440a55 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:19.182691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c298f-e8c1-4549-be3c-b6fd9d024f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:19.183314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c298f-e8c1-4549-be3c-b6fd9d024f11 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:19.183615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c298f-e8c1-4549-be3c-b6fd9d024f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:19.183884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c298f-e8c1-4549-be3c-b6fd9d024f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:19.185493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b70c298f-e8c1-4549-be3c-b6fd9d024f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:19.307039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c298f-e8c1-4549-be3c-b6fd9d024f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:19.308506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c298f-e8c1-4549-be3c-b6fd9d024f11 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:19.329461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 669/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:23.664472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7865a-9f6b-45ae-b81a-0b1fdade35f2 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:23.664976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7865a-9f6b-45ae-b81a-0b1fdade35f2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:23.665071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7865a-9f6b-45ae-b81a-0b1fdade35f2 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:23.666356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 678/1347] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:23.671735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf299ff-e8bf-42ce-a5ce-dfa38e72c5c7 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:23.672166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf299ff-e8bf-42ce-a5ce-dfa38e72c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:23.672271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf299ff-e8bf-42ce-a5ce-dfa38e72c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:23.687673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:23.767356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ecf299ff-e8bf-42ce-a5ce-dfa38e72c5c7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:23.769428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ecf299ff-e8bf-42ce-a5ce-dfa38e72c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:23.890787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 670/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:24.171797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7865a-9f6b-45ae-b81a-0b1fdade35f2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:24.173362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c6e7865a-9f6b-45ae-b81a-0b1fdade35f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:24.230865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:24.276936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7865a-9f6b-45ae-b81a-0b1fdade35f2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:24.351711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d70bb3-de51-4526-b75c-54278930fd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:24.352299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70bb3-de51-4526-b75c-54278930fd0a service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:24.352570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70bb3-de51-4526-b75c-54278930fd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:24.352859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70bb3-de51-4526-b75c-54278930fd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:24.354423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d4d70bb3-de51-4526-b75c-54278930fd0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:24.459375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:24.462862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d70bb3-de51-4526-b75c-54278930fd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:24.464342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d70bb3-de51-4526-b75c-54278930fd0a service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:24.483981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 679/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:29.508200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c1266-d929-45ff-96c2-0b3d6f5fe728 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:29.508200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c1266-d929-45ff-96c2-0b3d6f5fe728 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:29.508200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c1266-d929-45ff-96c2-0b3d6f5fe728 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:29.513460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 671/1350] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:41:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:29.530404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0507-ce01-4b2b-8c09-4f9ba314d80e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:29.530404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0507-ce01-4b2b-8c09-4f9ba314d80e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:29.530404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0507-ce01-4b2b-8c09-4f9ba314d80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:29.661361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-382a0507-ce01-4b2b-8c09-4f9ba314d80e None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:29.662995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-382a0507-ce01-4b2b-8c09-4f9ba314d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:29.824929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 680/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:33.889300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=59 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:33.985329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8687-42c2-4262-a0c4-a995f6717f85 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:33.985685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8687-42c2-4262-a0c4-a995f6717f85 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:33.985875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8687-42c2-4262-a0c4-a995f6717f85 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:33.987768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 672/1352] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:33.992949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae2d4-8193-4858-8636-29a604264204 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:33.993420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae2d4-8193-4858-8636-29a604264204 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:33.993501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae2d4-8193-4858-8636-29a604264204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:34.050542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:34.073772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-edfae2d4-8193-4858-8636-29a604264204 None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:34.074958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-edfae2d4-8193-4858-8636-29a604264204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:34.189519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 681/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:41:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:35.519866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543dc44-a803-4d46-a365-4b2a66c0177a None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:35.520701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543dc44-a803-4d46-a365-4b2a66c0177a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:35.520970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543dc44-a803-4d46-a365-4b2a66c0177a None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:35.522497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 673/1354] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:35.527520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcea1c-26b6-4179-9aac-0e7de56d345f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:35.527939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcea1c-26b6-4179-9aac-0e7de56d345f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:35.528191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcea1c-26b6-4179-9aac-0e7de56d345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:35.608833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-20bcea1c-26b6-4179-9aac-0e7de56d345f None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:35.610052 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-20bcea1c-26b6-4179-9aac-0e7de56d345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:35.652717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:35.717900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 682/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:41:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:39.337992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2fb1b-8db8-4572-b3e1-30b8db8ebc89 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:39.338563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2fb1b-8db8-4572-b3e1-30b8db8ebc89 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:39.338654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2fb1b-8db8-4572-b3e1-30b8db8ebc89 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:39.340183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 674/1356] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:39.347438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f22b6-d556-4b44-ae02-c6604fca0130 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:39.348746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f22b6-d556-4b44-ae02-c6604fca0130 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:39.349210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f22b6-d556-4b44-ae02-c6604fca0130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:39.447001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d01f22b6-d556-4b44-ae02-c6604fca0130 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:39.452518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d01f22b6-d556-4b44-ae02-c6604fca0130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:39.555503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 683/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:41:39.868150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b5da-0120-42cf-aee6-ae46151da0e6 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:39.869573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b5da-0120-42cf-aee6-ae46151da0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:39.869573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b5da-0120-42cf-aee6-ae46151da0e6 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:39.870631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 675/1358] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 28 08:41:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:39.880301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0e869-a9db-45d4-9e8a-ab61c302ddf7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:39.881174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0e869-a9db-45d4-9e8a-ab61c302ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:39.882065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0e869-a9db-45d4-9e8a-ab61c302ddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:39.903391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:39.973788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-05b0e869-a9db-45d4-9e8a-ab61c302ddf7 None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:39.974987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-05b0e869-a9db-45d4-9e8a-ab61c302ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:40.102284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 684/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 28 08:41:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:40.111117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b5da-0120-42cf-aee6-ae46151da0e6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:40.112651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-dc71b5da-0120-42cf-aee6-ae46151da0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:40.278205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b5da-0120-42cf-aee6-ae46151da0e6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:40.360309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:40.402538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1ac7a-147d-4ed3-92ee-a4b24accc544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:40.403161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ac7a-147d-4ed3-92ee-a4b24accc544 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:40.403445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ac7a-147d-4ed3-92ee-a4b24accc544 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:40.404907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1ac7a-147d-4ed3-92ee-a4b24accc544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:40.406551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6fb1ac7a-147d-4ed3-92ee-a4b24accc544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:40.507346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ac7a-147d-4ed3-92ee-a4b24accc544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:40.509087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1ac7a-147d-4ed3-92ee-a4b24accc544 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:40.530715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 676/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:42.923745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5d88-67c7-4e08-b8f9-2a34c2a00af2 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:42.924271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5d88-67c7-4e08-b8f9-2a34c2a00af2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:42.924361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b5d88-67c7-4e08-b8f9-2a34c2a00af2 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:42.927529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 685/1361] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:42.931105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1dd99-5c45-44ab-9a69-db681522bf7b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:42.931590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1dd99-5c45-44ab-9a69-db681522bf7b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:42.931926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1dd99-5c45-44ab-9a69-db681522bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:43.024044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7dc1dd99-5c45-44ab-9a69-db681522bf7b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:43.026012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7dc1dd99-5c45-44ab-9a69-db681522bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:43.070373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:43.143824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 677/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:43.429909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b5d88-67c7-4e08-b8f9-2a34c2a00af2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:43.431442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a03b5d88-67c7-4e08-b8f9-2a34c2a00af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:43.505833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:43.600569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b5d88-67c7-4e08-b8f9-2a34c2a00af2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:43.743197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17cffe-7dd5-4715-8bd7-905547bcc478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:43.743941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17cffe-7dd5-4715-8bd7-905547bcc478 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:43.744130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17cffe-7dd5-4715-8bd7-905547bcc478 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:43.744379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17cffe-7dd5-4715-8bd7-905547bcc478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:43.745936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4b17cffe-7dd5-4715-8bd7-905547bcc478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:43.780804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:43.852098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17cffe-7dd5-4715-8bd7-905547bcc478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:43.853615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17cffe-7dd5-4715-8bd7-905547bcc478 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:43.873521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 686/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:46.520253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c24a-66ba-40b1-8589-4f0ecf240f2e None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:46.520839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c24a-66ba-40b1-8589-4f0ecf240f2e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:46.520839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c24a-66ba-40b1-8589-4f0ecf240f2e None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:46.522399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 678/1364] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:46.527527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9ac55-7ed0-4bf3-b350-23f8b4cdc97a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:46.527929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9ac55-7ed0-4bf3-b350-23f8b4cdc97a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:46.528142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9ac55-7ed0-4bf3-b350-23f8b4cdc97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:46.598865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-aeb9ac55-7ed0-4bf3-b350-23f8b4cdc97a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:46.600447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-aeb9ac55-7ed0-4bf3-b350-23f8b4cdc97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:46.704976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:46.711468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 687/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:47.004831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1c4b0-dd4c-4a01-a489-472d9b9be76a None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:47.005189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1c4b0-dd4c-4a01-a489-472d9b9be76a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:47.005534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1c4b0-dd4c-4a01-a489-472d9b9be76a None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:47.007018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 679/1366] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 28 08:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:47.012427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcbd07-6eef-46d9-9814-df0dddb2c7e7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:47.018366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcbd07-6eef-46d9-9814-df0dddb2c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:47.018366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcbd07-6eef-46d9-9814-df0dddb2c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:47.096752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b2bcbd07-6eef-46d9-9814-df0dddb2c7e7 None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:47.098446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b2bcbd07-6eef-46d9-9814-df0dddb2c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:47.227195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 688/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 28 08:41:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:47.236095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1c4b0-dd4c-4a01-a489-472d9b9be76a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:47.237611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-79d1c4b0-dd4c-4a01-a489-472d9b9be76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:47.401798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1c4b0-dd4c-4a01-a489-472d9b9be76a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:47.425475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:47.527120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769b539-733e-400c-861a-27cb177324bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:47.527809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b539-733e-400c-861a-27cb177324bc service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:47.528101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b539-733e-400c-861a-27cb177324bc service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:47.528457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b539-733e-400c-861a-27cb177324bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:47.530317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2769b539-733e-400c-861a-27cb177324bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:47.637050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769b539-733e-400c-861a-27cb177324bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:47.639912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769b539-733e-400c-861a-27cb177324bc service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:47.660350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 680/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:41:47.681231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533436-f4fb-46d0-8e08-5a0793ba8dc2 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:47.681723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533436-f4fb-46d0-8e08-5a0793ba8dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:47.681821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533436-f4fb-46d0-8e08-5a0793ba8dc2 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:47.683596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 689/1369] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:47.688919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231461a0-2a96-4b5c-9d21-c0629ec33730 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:47.689208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231461a0-2a96-4b5c-9d21-c0629ec33730 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:47.689494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231461a0-2a96-4b5c-9d21-c0629ec33730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:47.724212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:47.759476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-231461a0-2a96-4b5c-9d21-c0629ec33730 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:47.760773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-231461a0-2a96-4b5c-9d21-c0629ec33730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:47.878144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 681/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:48.213321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24e3a1-58a8-4955-b3d0-37476d411f49 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:48.213596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24e3a1-58a8-4955-b3d0-37476d411f49 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:48.213871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24e3a1-58a8-4955-b3d0-37476d411f49 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:48.216305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 690/1371] 10.222.0.57 () {54 vars in 963 bytes} [Wed Sep 28 08:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:48.220951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee548b9-0c48-4de0-bdd7-acc0550b8805 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:48.221347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee548b9-0c48-4de0-bdd7-acc0550b8805 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:48.221728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee548b9-0c48-4de0-bdd7-acc0550b8805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:48.311490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9ee548b9-0c48-4de0-bdd7-acc0550b8805 None None] MFA Rules not processed for user `d053a3f1d07641b586518ae0c0a39e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:48.312864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9ee548b9-0c48-4de0-bdd7-acc0550b8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:48.368047 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:48.403282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 682/1372] 10.222.0.57 () {58 vars in 1060 bytes} [Wed Sep 28 08:41:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:48.411445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24e3a1-58a8-4955-b3d0-37476d411f49 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:48.412947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2d24e3a1-58a8-4955-b3d0-37476d411f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:48.467082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:48.522377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24e3a1-58a8-4955-b3d0-37476d411f49 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:48.618771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2b9db-cf53-49c5-908b-6a71cc94080a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:48.619492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2b9db-cf53-49c5-908b-6a71cc94080a service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:48.619929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2b9db-cf53-49c5-908b-6a71cc94080a service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:48.620310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2b9db-cf53-49c5-908b-6a71cc94080a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:48.622651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-61d2b9db-cf53-49c5-908b-6a71cc94080a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:48.723161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:48.741305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2b9db-cf53-49c5-908b-6a71cc94080a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:48.743750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2b9db-cf53-49c5-908b-6a71cc94080a service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:48.778712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 691/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:50.138861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13ee7-f5b9-47a5-9bfa-fb096d4a2f7c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:50.139447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13ee7-f5b9-47a5-9bfa-fb096d4a2f7c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:50.139447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13ee7-f5b9-47a5-9bfa-fb096d4a2f7c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:50.140798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 683/1374] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:50.146118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b73bf-7ebf-4036-aa90-f026ea25c1cd None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:50.146534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b73bf-7ebf-4036-aa90-f026ea25c1cd None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:50.146703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b73bf-7ebf-4036-aa90-f026ea25c1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:50.218603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-876b73bf-7ebf-4036-aa90-f026ea25c1cd None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:50.219904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-876b73bf-7ebf-4036-aa90-f026ea25c1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:50.317765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 692/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:50.614334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13ee7-f5b9-47a5-9bfa-fb096d4a2f7c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:50.616157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6ba13ee7-f5b9-47a5-9bfa-fb096d4a2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:50.767826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13ee7-f5b9-47a5-9bfa-fb096d4a2f7c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:50.822568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:50.890648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b98a78-53de-4edd-81ed-e8aff64f5cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:50.891263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98a78-53de-4edd-81ed-e8aff64f5cda service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:50.891578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98a78-53de-4edd-81ed-e8aff64f5cda service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:50.891852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b98a78-53de-4edd-81ed-e8aff64f5cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:50.893438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-78b98a78-53de-4edd-81ed-e8aff64f5cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:50.989224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b98a78-53de-4edd-81ed-e8aff64f5cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:50.991078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b98a78-53de-4edd-81ed-e8aff64f5cda service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:51.010251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 684/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:53.398972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108cfa0-28e7-42a4-9f01-c6139a1c430a None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:53.399611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108cfa0-28e7-42a4-9f01-c6139a1c430a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:53.399727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108cfa0-28e7-42a4-9f01-c6139a1c430a None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:53.401307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 693/1377] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:53.406507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341c2b-b185-4bf9-84c1-8b8ceb7c2189 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:53.407379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341c2b-b185-4bf9-84c1-8b8ceb7c2189 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:53.408135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341c2b-b185-4bf9-84c1-8b8ceb7c2189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:53.487596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ba341c2b-b185-4bf9-84c1-8b8ceb7c2189 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:53.489507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ba341c2b-b185-4bf9-84c1-8b8ceb7c2189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:53.498855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:53.600527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 685/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:41:53.898001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108cfa0-28e7-42a4-9f01-c6139a1c430a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:53.899522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e108cfa0-28e7-42a4-9f01-c6139a1c430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:53.970573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:54.057368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108cfa0-28e7-42a4-9f01-c6139a1c430a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:54.179580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f516880-9e87-4991-a53c-703ee06dc092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:54.180183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516880-9e87-4991-a53c-703ee06dc092 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:54.180461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516880-9e87-4991-a53c-703ee06dc092 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:54.180732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516880-9e87-4991-a53c-703ee06dc092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:54.182291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9f516880-9e87-4991-a53c-703ee06dc092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:54.203228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:54.277508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f516880-9e87-4991-a53c-703ee06dc092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:54.279215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f516880-9e87-4991-a53c-703ee06dc092 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:54.298122 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 694/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:41:56.623720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b1d6-8787-4e1a-a0f8-5cedf14c58a4 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:56.624229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b1d6-8787-4e1a-a0f8-5cedf14c58a4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:56.624395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84b1d6-8787-4e1a-a0f8-5cedf14c58a4 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:56.625752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 686/1380] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:41:56.631081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583393-1ed3-4136-80de-a82412e7a607 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:56.631560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583393-1ed3-4136-80de-a82412e7a607 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:56.631653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583393-1ed3-4136-80de-a82412e7a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:56.711320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-98583393-1ed3-4136-80de-a82412e7a607 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:41:56.712852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-98583393-1ed3-4136-80de-a82412e7a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:56.822510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:56.828493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 695/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:41:57.129679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b1d6-8787-4e1a-a0f8-5cedf14c58a4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:41:57.131249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9c84b1d6-8787-4e1a-a0f8-5cedf14c58a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:57.274504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:57.286416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84b1d6-8787-4e1a-a0f8-5cedf14c58a4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:41:57.412649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690266b-e394-47e5-ad91-4a6c4a27f2f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:41:57.413331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690266b-e394-47e5-ad91-4a6c4a27f2f6 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:41:57.413768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690266b-e394-47e5-ad91-4a6c4a27f2f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:41:57.414117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690266b-e394-47e5-ad91-4a6c4a27f2f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:41:57.416228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9690266b-e394-47e5-ad91-4a6c4a27f2f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:41:57.521152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690266b-e394-47e5-ad91-4a6c4a27f2f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:41:57.522797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690266b-e394-47e5-ad91-4a6c4a27f2f6 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:41:57.533461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:57.541906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 687/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:00.213326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b88a6-fb13-412e-9267-f9fd6b47e100 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:00.213887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b88a6-fb13-412e-9267-f9fd6b47e100 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:00.214038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b88a6-fb13-412e-9267-f9fd6b47e100 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:00.216068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 696/1383] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:00.222522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d96cb-36e7-4ce3-8516-5a55b140ea3f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:00.223116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d96cb-36e7-4ce3-8516-5a55b140ea3f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:00.223116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d96cb-36e7-4ce3-8516-5a55b140ea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:00.298223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9f2d96cb-36e7-4ce3-8516-5a55b140ea3f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:00.299444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9f2d96cb-36e7-4ce3-8516-5a55b140ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:00.413476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 688/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:00.704478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b88a6-fb13-412e-9267-f9fd6b47e100 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:00.706477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-878b88a6-fb13-412e-9267-f9fd6b47e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:00.885959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b88a6-fb13-412e-9267-f9fd6b47e100 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:00.960757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:01.128488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160ed1-edd8-4237-88be-cc896b3b252b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:01.129074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160ed1-edd8-4237-88be-cc896b3b252b service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:01.129353 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160ed1-edd8-4237-88be-cc896b3b252b service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:01.129630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160ed1-edd8-4237-88be-cc896b3b252b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:01.131185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ca160ed1-edd8-4237-88be-cc896b3b252b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:01.233524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160ed1-edd8-4237-88be-cc896b3b252b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:01.235159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160ed1-edd8-4237-88be-cc896b3b252b service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:01.255391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 697/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:42:03.445517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6ea0-558b-4cfc-9e26-ee9fff1dd954 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:03.446050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6ea0-558b-4cfc-9e26-ee9fff1dd954 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:03.446160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c6ea0-558b-4cfc-9e26-ee9fff1dd954 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:03.447452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 689/1386] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:03.452884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198968-fb6b-4710-a95d-eece7a712e71 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:03.453299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198968-fb6b-4710-a95d-eece7a712e71 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:03.453457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198968-fb6b-4710-a95d-eece7a712e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:03.521428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-56198968-fb6b-4710-a95d-eece7a712e71 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:03.522598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-56198968-fb6b-4710-a95d-eece7a712e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:03.554979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:03.618251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 698/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:03.910688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c6ea0-558b-4cfc-9e26-ee9fff1dd954 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:03.912243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-442c6ea0-558b-4cfc-9e26-ee9fff1dd954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:03.991861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:04.061102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c6ea0-558b-4cfc-9e26-ee9fff1dd954 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:04.176232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a35d-806c-4b1b-81e9-d659a3e16959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:04.176758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a35d-806c-4b1b-81e9-d659a3e16959 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:04.177035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a35d-806c-4b1b-81e9-d659a3e16959 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:04.177306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a35d-806c-4b1b-81e9-d659a3e16959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:04.178957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f3c7a35d-806c-4b1b-81e9-d659a3e16959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:04.223096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:04.281080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7a35d-806c-4b1b-81e9-d659a3e16959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:04.282669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7a35d-806c-4b1b-81e9-d659a3e16959 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:04.302168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 690/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:04.345752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfdfe-b930-489b-9c2b-5f841e2f5b31 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:04.346037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfdfe-b930-489b-9c2b-5f841e2f5b31 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:04.346310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfdfe-b930-489b-9c2b-5f841e2f5b31 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:04.347713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 699/1389] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:04.352846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9276c61-ca92-416a-8182-5205d6ad77e4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:04.353133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9276c61-ca92-416a-8182-5205d6ad77e4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:04.353410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9276c61-ca92-416a-8182-5205d6ad77e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:04.420855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a9276c61-ca92-416a-8182-5205d6ad77e4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:04.422121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a9276c61-ca92-416a-8182-5205d6ad77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:04.519890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 691/1390] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:04.852805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82480f-886d-4f04-82d3-9fe8a0da28ee None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:04.853333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82480f-886d-4f04-82d3-9fe8a0da28ee None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:04.853333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82480f-886d-4f04-82d3-9fe8a0da28ee None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:04.854681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 700/1391] 10.222.0.57 () {54 vars in 962 bytes} [Wed Sep 28 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:04.862492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810fdb-a214-4388-876b-093373c50c32 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:04.862810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810fdb-a214-4388-876b-093373c50c32 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:04.863114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810fdb-a214-4388-876b-093373c50c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:04.886247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:04.960168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5d810fdb-a214-4388-876b-093373c50c32 None None] MFA Rules not processed for user `d0570ef979ab4073898635be3fbb8894`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:04.961750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5d810fdb-a214-4388-876b-093373c50c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:05.057298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 692/1392] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Sep 28 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:05.069014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82480f-886d-4f04-82d3-9fe8a0da28ee None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:05.073606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-bc82480f-886d-4f04-82d3-9fe8a0da28ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:05.188148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82480f-886d-4f04-82d3-9fe8a0da28ee None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:05.266837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:05.281985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91802203-9949-4214-a18f-c6876225d826 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:05.282723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802203-9949-4214-a18f-c6876225d826 service glance] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:05.282992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802203-9949-4214-a18f-c6876225d826 service glance] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:05.283264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802203-9949-4214-a18f-c6876225d826 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:05.284911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-91802203-9949-4214-a18f-c6876225d826 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:05.420367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91802203-9949-4214-a18f-c6876225d826 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:05.421817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91802203-9949-4214-a18f-c6876225d826 service glance] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:05.444225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 701/1393] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:06.341575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb36e3-b0f4-43fe-9e07-ec54c54b33ff None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:06.342056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb36e3-b0f4-43fe-9e07-ec54c54b33ff None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:06.342292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb36e3-b0f4-43fe-9e07-ec54c54b33ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:06.411182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-eecb36e3-b0f4-43fe-9e07-ec54c54b33ff None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:06.412424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-eecb36e3-b0f4-43fe-9e07-ec54c54b33ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:06.471139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:06.500014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 693/1394] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:06.544877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373535f8-20b2-4118-87ad-b8bbcb0d6114 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:06.545329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373535f8-20b2-4118-87ad-b8bbcb0d6114 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:06.545407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373535f8-20b2-4118-87ad-b8bbcb0d6114 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:06.546750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 702/1395] 10.222.0.57 () {54 vars in 943 bytes} [Wed Sep 28 08:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:06.554276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526cac-065a-41b2-9687-526979160fe6 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:06.554563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526cac-065a-41b2-9687-526979160fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:06.554835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526cac-065a-41b2-9687-526979160fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:06.638389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8a526cac-065a-41b2-9687-526979160fe6 None None] MFA Rules not processed for user `6717f091388748d8aad2eafcb50fd61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:06.639616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8a526cac-065a-41b2-9687-526979160fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:06.691188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e031f3f-cc98-4df7-9a89-ee16bc2968f7 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:06.691675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e031f3f-cc98-4df7-9a89-ee16bc2968f7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:06.692026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e031f3f-cc98-4df7-9a89-ee16bc2968f7 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:06.693467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 703/1396] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:42:06.698731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:06.698961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:06.699261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:06.750531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 694/1397] 10.222.0.57 () {58 vars in 1040 bytes} [Wed Sep 28 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:06.759781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526cac-065a-41b2-9687-526979160fe6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:06.766971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:06.768280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:06.769014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526cac-065a-41b2-9687-526979160fe6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:06.795599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:06.810024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:06.866876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 704/1398] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:42:06.874968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b029d0-4d93-4fa2-b7dc-23f2d7cf93a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:06.875603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b029d0-4d93-4fa2-b7dc-23f2d7cf93a3 service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:06.876353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b029d0-4d93-4fa2-b7dc-23f2d7cf93a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:06.876353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b029d0-4d93-4fa2-b7dc-23f2d7cf93a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:06.877733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-22b029d0-4d93-4fa2-b7dc-23f2d7cf93a3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:06.972711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b029d0-4d93-4fa2-b7dc-23f2d7cf93a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:06.974312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b029d0-4d93-4fa2-b7dc-23f2d7cf93a3 service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:06.983513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 695/1399] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:42:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 08:42:07.170104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:07.171337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:07.282181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22cd1-330b-4593-b98d-4d33e3963a84 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:07.339230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:07.397023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7d08b-4768-453a-b446-81056d8ec028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:07.397631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d08b-4768-453a-b446-81056d8ec028 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:07.397907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d08b-4768-453a-b446-81056d8ec028 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:07.398172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d08b-4768-453a-b446-81056d8ec028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:07.399877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6af7d08b-4768-453a-b446-81056d8ec028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:07.508932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7d08b-4768-453a-b446-81056d8ec028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:07.510533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7d08b-4768-453a-b446-81056d8ec028 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:07.531994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 705/1400] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:09.886478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6009878-e225-4ab6-86a9-cd4f65e0d695 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:09.887725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6009878-e225-4ab6-86a9-cd4f65e0d695 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:09.887843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6009878-e225-4ab6-86a9-cd4f65e0d695 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:09.889138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 696/1401] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:09.894847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ddd2-3eea-4fcb-b271-5687de63f78a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:09.894847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ddd2-3eea-4fcb-b271-5687de63f78a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:09.895356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4ddd2-3eea-4fcb-b271-5687de63f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:09.974753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f4e4ddd2-3eea-4fcb-b271-5687de63f78a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:09.975995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f4e4ddd2-3eea-4fcb-b271-5687de63f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:10.001494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:10.099066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 706/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:10.396779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6009878-e225-4ab6-86a9-cd4f65e0d695 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:10.398295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d6009878-e225-4ab6-86a9-cd4f65e0d695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:10.470077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:10.573030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6009878-e225-4ab6-86a9-cd4f65e0d695 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:10.699290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a876cad-2cc1-4be4-8984-56e2518e7e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:10.699959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876cad-2cc1-4be4-8984-56e2518e7e9a service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:10.700241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876cad-2cc1-4be4-8984-56e2518e7e9a service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:10.700509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876cad-2cc1-4be4-8984-56e2518e7e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:10.702095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6a876cad-2cc1-4be4-8984-56e2518e7e9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:10.722063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:10.801497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876cad-2cc1-4be4-8984-56e2518e7e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:10.803082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a876cad-2cc1-4be4-8984-56e2518e7e9a service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:10.823637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 697/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:13.233630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960366-ce1c-4b7b-ab12-746f367bfe8f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:13.234178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960366-ce1c-4b7b-ab12-746f367bfe8f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:13.234178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960366-ce1c-4b7b-ab12-746f367bfe8f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:13.235450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 707/1404] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:13.240911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c6be1-4dcb-451b-90a5-12a05eb92ea5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:13.241316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c6be1-4dcb-451b-90a5-12a05eb92ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:13.241480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c6be1-4dcb-451b-90a5-12a05eb92ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:13.314060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-463c6be1-4dcb-451b-90a5-12a05eb92ea5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:13.315276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-463c6be1-4dcb-451b-90a5-12a05eb92ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:13.421365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:13.431470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 698/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:13.727947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9960366-ce1c-4b7b-ab12-746f367bfe8f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:13.729457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b9960366-ce1c-4b7b-ab12-746f367bfe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:13.885160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:13.888803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9960366-ce1c-4b7b-ab12-746f367bfe8f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:14.017579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fe42c-4cde-4918-a426-91d848e12c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:14.018187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe42c-4cde-4918-a426-91d848e12c12 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:14.018467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe42c-4cde-4918-a426-91d848e12c12 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:14.018737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe42c-4cde-4918-a426-91d848e12c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:14.020393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5c9fe42c-4cde-4918-a426-91d848e12c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:14.125134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fe42c-4cde-4918-a426-91d848e12c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:14.127062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fe42c-4cde-4918-a426-91d848e12c12 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:14.146176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 708/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:16.491863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2699ee-6688-4b07-b1dd-b9425abf12b7 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:16.492389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2699ee-6688-4b07-b1dd-b9425abf12b7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:16.492389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2699ee-6688-4b07-b1dd-b9425abf12b7 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:16.493787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 699/1407] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:16.499772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fee94-5574-4c9f-81f7-0f729c528f46 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:16.500229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fee94-5574-4c9f-81f7-0f729c528f46 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:16.500328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fee94-5574-4c9f-81f7-0f729c528f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:16.506817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:16.578415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-2f2fee94-5574-4c9f-81f7-0f729c528f46 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:16.579582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2f2fee94-5574-4c9f-81f7-0f729c528f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:16.687988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 709/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:16.978825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2699ee-6688-4b07-b1dd-b9425abf12b7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:16.980950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bb2699ee-6688-4b07-b1dd-b9425abf12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:17.151203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2699ee-6688-4b07-b1dd-b9425abf12b7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:17.218677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:17.270379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e05d7-a0bb-4915-bee6-2f358d51882d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:17.270993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e05d7-a0bb-4915-bee6-2f358d51882d service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:17.271273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e05d7-a0bb-4915-bee6-2f358d51882d service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:17.271578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e05d7-a0bb-4915-bee6-2f358d51882d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:17.273152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c41e05d7-a0bb-4915-bee6-2f358d51882d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:17.381395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e05d7-a0bb-4915-bee6-2f358d51882d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:17.383106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e05d7-a0bb-4915-bee6-2f358d51882d service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:17.407457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 700/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:26.686487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=64 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:27.404660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=64 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:31.415055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9e9b-599d-4abb-a532-0b96fa9db035 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:31.415627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9e9b-599d-4abb-a532-0b96fa9db035 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:31.415627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9e9b-599d-4abb-a532-0b96fa9db035 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:31.417480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 710/1410] 10.222.0.57 () {54 vars in 918 bytes} [Wed Sep 28 08:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:31.422631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27de9f-5c37-4916-9858-b0dbebdf9b6b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:31.423082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27de9f-5c37-4916-9858-b0dbebdf9b6b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:31.423201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27de9f-5c37-4916-9858-b0dbebdf9b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:31.500099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ed27de9f-5c37-4916-9858-b0dbebdf9b6b None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:31.501310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ed27de9f-5c37-4916-9858-b0dbebdf9b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:31.608029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 701/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Sep 28 08:42:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:31.622472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabc322-0f21-4fa2-9e63-0092a4ea0fa5 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:31.622781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabc322-0f21-4fa2-9e63-0092a4ea0fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:31.623056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabc322-0f21-4fa2-9e63-0092a4ea0fa5 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:31.624403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 711/1412] 10.222.0.57 () {54 vars in 918 bytes} [Wed Sep 28 08:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:31.629167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b38d1-7688-43cd-9b94-ce5fcb68305a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:31.629450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b38d1-7688-43cd-9b94-ce5fcb68305a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:31.629719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b38d1-7688-43cd-9b94-ce5fcb68305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:31.702464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:31.704933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ff4b38d1-7688-43cd-9b94-ce5fcb68305a None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:31.706148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ff4b38d1-7688-43cd-9b94-ce5fcb68305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:31.820445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 702/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Sep 28 08:42:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:34.432502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d6ce-fad7-49c0-9a29-2693f1072250 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:34.433547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d6ce-fad7-49c0-9a29-2693f1072250 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:34.433654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d6ce-fad7-49c0-9a29-2693f1072250 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:34.434968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:34.440322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d2f65-a99e-4959-a330-ac866cd112a1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:34.440707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d2f65-a99e-4959-a330-ac866cd112a1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:34.440877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d2f65-a99e-4959-a330-ac866cd112a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:34.511399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-654d2f65-a99e-4959-a330-ac866cd112a1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:34.511931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-654d2f65-a99e-4959-a330-ac866cd112a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:34.568773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:34.612017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:42:34.911262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550d6ce-fad7-49c0-9a29-2693f1072250 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:34.912874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a550d6ce-fad7-49c0-9a29-2693f1072250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:35.060494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550d6ce-fad7-49c0-9a29-2693f1072250 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:35.136171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:35.176397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae0af3-8b99-45b3-b566-dbcbcafd31ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:35.176922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae0af3-8b99-45b3-b566-dbcbcafd31ee service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:35.177198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae0af3-8b99-45b3-b566-dbcbcafd31ee service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:35.177463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae0af3-8b99-45b3-b566-dbcbcafd31ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:35.179030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-83ae0af3-8b99-45b3-b566-dbcbcafd31ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:35.268017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae0af3-8b99-45b3-b566-dbcbcafd31ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:35.269880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae0af3-8b99-45b3-b566-dbcbcafd31ee service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:35.287248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 713/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:36.432475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211afc-506e-4412-9c82-0c355880af0d None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:36.433040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211afc-506e-4412-9c82-0c355880af0d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:36.433040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211afc-506e-4412-9c82-0c355880af0d None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:36.434388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:36.440708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f858b-dc0e-4d08-a5ff-06b8fabdd3f4 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:36.441141 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f858b-dc0e-4d08-a5ff-06b8fabdd3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:36.441271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f858b-dc0e-4d08-a5ff-06b8fabdd3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:36.517858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-677f858b-dc0e-4d08-a5ff-06b8fabdd3f4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:36.519265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-677f858b-dc0e-4d08-a5ff-06b8fabdd3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:36.546901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:36.619379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:36.770911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211afc-506e-4412-9c82-0c355880af0d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:36.772480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f4211afc-506e-4412-9c82-0c355880af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:36.919186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211afc-506e-4412-9c82-0c355880af0d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:36.958293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:37.029638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde633a-3442-40a1-8701-ecd4c772d3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:37.030173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde633a-3442-40a1-8701-ecd4c772d3ed service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:37.030458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde633a-3442-40a1-8701-ecd4c772d3ed service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:37.030728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde633a-3442-40a1-8701-ecd4c772d3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:37.032345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2cde633a-3442-40a1-8701-ecd4c772d3ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:37.120135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde633a-3442-40a1-8701-ecd4c772d3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:37.121705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde633a-3442-40a1-8701-ecd4c772d3ed service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:37.139731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 705/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:38.272764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe7803-2400-485f-aefa-b96d1016b3f8 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:38.273303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe7803-2400-485f-aefa-b96d1016b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:38.273303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe7803-2400-485f-aefa-b96d1016b3f8 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:38.274659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:38.281501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b025-c649-4d64-9052-c736484f36bb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:38.281943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b025-c649-4d64-9052-c736484f36bb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:38.282049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b025-c649-4d64-9052-c736484f36bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:38.335608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:38.358181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-56e6b025-c649-4d64-9052-c736484f36bb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:38.359388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-56e6b025-c649-4d64-9052-c736484f36bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:38.455258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:38.608721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe7803-2400-485f-aefa-b96d1016b3f8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:38.610152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-25fe7803-2400-485f-aefa-b96d1016b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:38.754205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe7803-2400-485f-aefa-b96d1016b3f8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:38.766892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:38.865612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ce13-da57-40d8-a42a-35a1fdf45447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:38.866134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ce13-da57-40d8-a42a-35a1fdf45447 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:38.866411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ce13-da57-40d8-a42a-35a1fdf45447 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:38.866679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ce13-da57-40d8-a42a-35a1fdf45447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:38.868287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7260ce13-da57-40d8-a42a-35a1fdf45447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:38.959370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260ce13-da57-40d8-a42a-35a1fdf45447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:38.961006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260ce13-da57-40d8-a42a-35a1fdf45447 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:38.979938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 716/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:40.107969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aacc4-731a-47b0-ae96-302ff1bceacd None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:40.108506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aacc4-731a-47b0-ae96-302ff1bceacd None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:40.108506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aacc4-731a-47b0-ae96-302ff1bceacd None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:40.109805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:40.116437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aa44c-a257-4aff-aa47-5e8339ffaebb None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:40.116846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aa44c-a257-4aff-aa47-5e8339ffaebb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:40.116989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aa44c-a257-4aff-aa47-5e8339ffaebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:40.137225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:40.193190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-739aa44c-a257-4aff-aa47-5e8339ffaebb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:40.194394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-739aa44c-a257-4aff-aa47-5e8339ffaebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:40.288163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:40.438889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aacc4-731a-47b0-ae96-302ff1bceacd None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:40.440348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-705aacc4-731a-47b0-ae96-302ff1bceacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:40.548922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:40.584030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aacc4-731a-47b0-ae96-302ff1bceacd None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:40.695779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0cb98-c1ab-4fbe-9864-d3ef074c6852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:40.696295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0cb98-c1ab-4fbe-9864-d3ef074c6852 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:40.696572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0cb98-c1ab-4fbe-9864-d3ef074c6852 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:40.696843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0cb98-c1ab-4fbe-9864-d3ef074c6852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:40.698460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-71f0cb98-c1ab-4fbe-9864-d3ef074c6852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:40.774475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:40.788039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0cb98-c1ab-4fbe-9864-d3ef074c6852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:40.789651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0cb98-c1ab-4fbe-9864-d3ef074c6852 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:40.808186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 708/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:41.938995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6f80-8cbc-4845-9890-c6c52a290934 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:41.939547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6f80-8cbc-4845-9890-c6c52a290934 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:41.939659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e6f80-8cbc-4845-9890-c6c52a290934 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:41.940993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:41.947294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4f2c8-df50-4819-bca9-4a11322567ec None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:41.948282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4f2c8-df50-4819-bca9-4a11322567ec None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:41.948605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4f2c8-df50-4819-bca9-4a11322567ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:42.025250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-43c4f2c8-df50-4819-bca9-4a11322567ec None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:42.026480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-43c4f2c8-df50-4819-bca9-4a11322567ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:42.123364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:42.276280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e6f80-8cbc-4845-9890-c6c52a290934 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:42.277786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-703e6f80-8cbc-4845-9890-c6c52a290934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:42.361306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:42.425878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e6f80-8cbc-4845-9890-c6c52a290934 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:42.540187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d909a-36b1-4a7e-9d7f-56d848fbf9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:42.540702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d909a-36b1-4a7e-9d7f-56d848fbf9e0 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:42.540983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d909a-36b1-4a7e-9d7f-56d848fbf9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:42.541251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d909a-36b1-4a7e-9d7f-56d848fbf9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:42.543602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-da8d909a-36b1-4a7e-9d7f-56d848fbf9e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:42.595399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:42.637718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d909a-36b1-4a7e-9d7f-56d848fbf9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:42.639314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d909a-36b1-4a7e-9d7f-56d848fbf9e0 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:42.657682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 719/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:43.772224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2535-08bf-4061-a7b3-1984f4ceae39 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:43.772771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2535-08bf-4061-a7b3-1984f4ceae39 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:43.772903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2535-08bf-4061-a7b3-1984f4ceae39 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:43.774286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:43.780590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8ae8-2d21-48e5-888d-bfc5eace9d4d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:43.781059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8ae8-2d21-48e5-888d-bfc5eace9d4d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:43.781159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8ae8-2d21-48e5-888d-bfc5eace9d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:43.859938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b90a8ae8-2d21-48e5-888d-bfc5eace9d4d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:43.861119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b90a8ae8-2d21-48e5-888d-bfc5eace9d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:43.957588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:44.109017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2535-08bf-4061-a7b3-1984f4ceae39 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:44.110441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0bda2535-08bf-4061-a7b3-1984f4ceae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:44.159621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:44.255003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2535-08bf-4061-a7b3-1984f4ceae39 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:44.365510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1738-191e-43f9-a50b-5d0f935f6703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:44.366042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1738-191e-43f9-a50b-5d0f935f6703 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:44.366323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1738-191e-43f9-a50b-5d0f935f6703 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:44.366596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1738-191e-43f9-a50b-5d0f935f6703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:44.368220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fc6b1738-191e-43f9-a50b-5d0f935f6703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:44.375119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:44.457053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b1738-191e-43f9-a50b-5d0f935f6703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:44.458635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b1738-191e-43f9-a50b-5d0f935f6703 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:44.476817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 711/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:45.588566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d217-207d-4e30-9f71-576048ccfa15 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:45.589212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d217-207d-4e30-9f71-576048ccfa15 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:45.589212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d217-207d-4e30-9f71-576048ccfa15 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:45.590457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:45.596939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbacf7-a9db-41d9-b67b-d33c806432d0 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:45.597436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbacf7-a9db-41d9-b67b-d33c806432d0 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:45.597624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbacf7-a9db-41d9-b67b-d33c806432d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:45.674896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-82dbacf7-a9db-41d9-b67b-d33c806432d0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:45.676044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-82dbacf7-a9db-41d9-b67b-d33c806432d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:45.743934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:45.772190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:45.923793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d217-207d-4e30-9f71-576048ccfa15 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:45.925535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7ee8d217-207d-4e30-9f71-576048ccfa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:45.942973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:46.069676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d217-207d-4e30-9f71-576048ccfa15 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:46.158043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:46.185412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c8d75-0bf9-4e58-b350-911e0345b49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:46.185978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8d75-0bf9-4e58-b350-911e0345b49a service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:46.186255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8d75-0bf9-4e58-b350-911e0345b49a service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:46.186531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8d75-0bf9-4e58-b350-911e0345b49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:46.188161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b77c8d75-0bf9-4e58-b350-911e0345b49a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:46.277718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c8d75-0bf9-4e58-b350-911e0345b49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:46.279305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c8d75-0bf9-4e58-b350-911e0345b49a service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:46.297345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 722/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:47.453855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38866-29b6-43e0-a220-c14ff917ce3c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:47.454423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38866-29b6-43e0-a220-c14ff917ce3c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:47.454423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38866-29b6-43e0-a220-c14ff917ce3c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:47.455786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:47.461927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35694fe7-d1a4-484c-9308-3ceee54473fc None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:47.462339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35694fe7-d1a4-484c-9308-3ceee54473fc None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:47.462479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35694fe7-d1a4-484c-9308-3ceee54473fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:47.536960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-35694fe7-d1a4-484c-9308-3ceee54473fc None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:47.538155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-35694fe7-d1a4-484c-9308-3ceee54473fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:47.580016 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:47.634286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:47.785354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38866-29b6-43e0-a220-c14ff917ce3c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:47.786853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ddb38866-29b6-43e0-a220-c14ff917ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:47.929397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38866-29b6-43e0-a220-c14ff917ce3c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:47.983750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:48.040590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d2b4a-0141-4193-9506-b610aa1713b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:48.041125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2b4a-0141-4193-9506-b610aa1713b2 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:48.042002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2b4a-0141-4193-9506-b610aa1713b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:48.042274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d2b4a-0141-4193-9506-b610aa1713b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:48.043881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-396d2b4a-0141-4193-9506-b610aa1713b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:48.130553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d2b4a-0141-4193-9506-b610aa1713b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:48.132163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d2b4a-0141-4193-9506-b610aa1713b2 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:48.149692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 714/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:49.286922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551e98-5f37-4317-9611-6026c0815fb2 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:49.287478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551e98-5f37-4317-9611-6026c0815fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:49.287478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551e98-5f37-4317-9611-6026c0815fb2 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:49.288870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:49.295592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4276a7-d732-4c18-9a38-a10004f58151 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:49.296045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4276a7-d732-4c18-9a38-a10004f58151 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:49.296173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4276a7-d732-4c18-9a38-a10004f58151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:49.378762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5b4276a7-d732-4c18-9a38-a10004f58151 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:49.379995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5b4276a7-d732-4c18-9a38-a10004f58151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:49.381982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:49.486801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:49.640544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2551e98-5f37-4317-9611-6026c0815fb2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:49.642008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b2551e98-5f37-4317-9611-6026c0815fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:49.787714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2551e98-5f37-4317-9611-6026c0815fb2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:49.816429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:49.903176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe24202-3118-45bf-85b0-ea461ac99e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:49.903747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe24202-3118-45bf-85b0-ea461ac99e16 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:49.904028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe24202-3118-45bf-85b0-ea461ac99e16 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:49.904300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe24202-3118-45bf-85b0-ea461ac99e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:49.905954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8fe24202-3118-45bf-85b0-ea461ac99e16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:49.996095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe24202-3118-45bf-85b0-ea461ac99e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:49.997675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe24202-3118-45bf-85b0-ea461ac99e16 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:50.014943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 725/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:52.126808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1df5f-7501-43c6-ae7a-20d0bc9c361c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:52.127361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1df5f-7501-43c6-ae7a-20d0bc9c361c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:52.127361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1df5f-7501-43c6-ae7a-20d0bc9c361c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:52.128770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:52.133995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905126-d960-4ffb-b967-816cf962e958 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:52.134434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905126-d960-4ffb-b967-816cf962e958 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:52.134534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905126-d960-4ffb-b967-816cf962e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:52.177231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:52.202388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-59905126-d960-4ffb-b967-816cf962e958 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:52.203651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-59905126-d960-4ffb-b967-816cf962e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:52.302381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:52.590872 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1df5f-7501-43c6-ae7a-20d0bc9c361c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:52.592441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-93b1df5f-7501-43c6-ae7a-20d0bc9c361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:52.695133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1df5f-7501-43c6-ae7a-20d0bc9c361c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:52.727592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:52.768997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c0496-349c-40aa-b57b-eff642a33ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:52.769599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c0496-349c-40aa-b57b-eff642a33ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:52.769874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c0496-349c-40aa-b57b-eff642a33ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:52.770146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c0496-349c-40aa-b57b-eff642a33ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:52.771738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f75c0496-349c-40aa-b57b-eff642a33ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:52.879749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c0496-349c-40aa-b57b-eff642a33ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:52.881124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c0496-349c-40aa-b57b-eff642a33ae4 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:52.900429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 717/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:55.199608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae35533-35d8-4169-aefa-f9955a61e6b5 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:55.200165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae35533-35d8-4169-aefa-f9955a61e6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:55.200165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae35533-35d8-4169-aefa-f9955a61e6b5 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:55.201444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:55.206763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ddb9a-03e2-4843-a020-304131408f42 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:55.207257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ddb9a-03e2-4843-a020-304131408f42 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:55.207383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ddb9a-03e2-4843-a020-304131408f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:55.273174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0a1ddb9a-03e2-4843-a020-304131408f42 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:55.274372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0a1ddb9a-03e2-4843-a020-304131408f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:55.287609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:55.372184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:55.662739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae35533-35d8-4169-aefa-f9955a61e6b5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:55.664315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-dae35533-35d8-4169-aefa-f9955a61e6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:55.767136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae35533-35d8-4169-aefa-f9955a61e6b5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:55.779604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:55.841913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceea36-433f-493d-9501-e9d4b2e26b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:55.842513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceea36-433f-493d-9501-e9d4b2e26b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:55.842792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceea36-433f-493d-9501-e9d4b2e26b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:55.843067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceea36-433f-493d-9501-e9d4b2e26b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:55.844675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a3ceea36-433f-493d-9501-e9d4b2e26b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:55.952665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceea36-433f-493d-9501-e9d4b2e26b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:55.954108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceea36-433f-493d-9501-e9d4b2e26b91 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:55.973050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 728/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:42:58.516471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf8b9-d254-4eb1-a926-39955b4d59ae None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:58.517029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf8b9-d254-4eb1-a926-39955b4d59ae None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:58.517029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf8b9-d254-4eb1-a926-39955b4d59ae None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:58.518365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:42:58.523650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097d28-1d0d-49cb-a6f0-94c33aebe4b1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:58.524115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097d28-1d0d-49cb-a6f0-94c33aebe4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:58.524215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097d28-1d0d-49cb-a6f0-94c33aebe4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:58.572486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:58.590917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c3097d28-1d0d-49cb-a6f0-94c33aebe4b1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:42:58.592170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c3097d28-1d0d-49cb-a6f0-94c33aebe4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:58.688171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:42:58.973957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bf8b9-d254-4eb1-a926-39955b4d59ae None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:42:58.975513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-097bf8b9-d254-4eb1-a926-39955b4d59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:59.079020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bf8b9-d254-4eb1-a926-39955b4d59ae None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:42:59.118758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:59.151944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bd6d5-5336-444a-8fc8-d7d7ecf4d284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:42:59.152543 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd6d5-5336-444a-8fc8-d7d7ecf4d284 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:42:59.152830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd6d5-5336-444a-8fc8-d7d7ecf4d284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:42:59.153101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd6d5-5336-444a-8fc8-d7d7ecf4d284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:42:59.154676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6f3bd6d5-5336-444a-8fc8-d7d7ecf4d284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:42:59.262573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bd6d5-5336-444a-8fc8-d7d7ecf4d284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:42:59.264059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bd6d5-5336-444a-8fc8-d7d7ecf4d284 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:42:59.282352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 720/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:01.568671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a999a-604b-4d3f-b687-f9154e2f550c None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:01.569191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a999a-604b-4d3f-b687-f9154e2f550c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:01.569191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a999a-604b-4d3f-b687-f9154e2f550c None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:01.570570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:01.576703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffbe12-2c72-47fc-a9ee-acfd7320d0d4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:01.577145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffbe12-2c72-47fc-a9ee-acfd7320d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:01.577338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffbe12-2c72-47fc-a9ee-acfd7320d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:01.643022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1cffbe12-2c72-47fc-a9ee-acfd7320d0d4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:01.644240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1cffbe12-2c72-47fc-a9ee-acfd7320d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:01.665141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:01.742267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:02.042399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a999a-604b-4d3f-b687-f9154e2f550c None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:02.043980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-560a999a-604b-4d3f-b687-f9154e2f550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:02.147185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a999a-604b-4d3f-b687-f9154e2f550c None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:02.167235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:02.221444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caa1c3-5666-4b69-ba3c-4422b9f70904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:02.221966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caa1c3-5666-4b69-ba3c-4422b9f70904 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:02.222244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caa1c3-5666-4b69-ba3c-4422b9f70904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:02.222516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caa1c3-5666-4b69-ba3c-4422b9f70904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:02.224101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a6caa1c3-5666-4b69-ba3c-4422b9f70904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:02.331647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caa1c3-5666-4b69-ba3c-4422b9f70904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:02.333071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caa1c3-5666-4b69-ba3c-4422b9f70904 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:02.351183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 731/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:04.555110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60dd6-dae2-4a38-acbb-dde8771da8d7 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:04.555697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60dd6-dae2-4a38-acbb-dde8771da8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:04.555697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60dd6-dae2-4a38-acbb-dde8771da8d7 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:04.557738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:04.563377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8ac4-0068-4ca0-8bda-8ff890e147ba None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:04.567843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8ac4-0068-4ca0-8bda-8ff890e147ba None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:04.567843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8ac4-0068-4ca0-8bda-8ff890e147ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:04.628576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:04.631271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-5e7c8ac4-0068-4ca0-8bda-8ff890e147ba None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:04.632500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5e7c8ac4-0068-4ca0-8bda-8ff890e147ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:04.728242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:05.013222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c60dd6-dae2-4a38-acbb-dde8771da8d7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:05.014745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-82c60dd6-dae2-4a38-acbb-dde8771da8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:05.117285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c60dd6-dae2-4a38-acbb-dde8771da8d7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:05.166030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:05.191070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e25e87-53e2-4dfa-a9c7-9d44d334abb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:05.196823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25e87-53e2-4dfa-a9c7-9d44d334abb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:05.196823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25e87-53e2-4dfa-a9c7-9d44d334abb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:05.196823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e25e87-53e2-4dfa-a9c7-9d44d334abb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:05.196823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-94e25e87-53e2-4dfa-a9c7-9d44d334abb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:05.302126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e25e87-53e2-4dfa-a9c7-9d44d334abb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:05.303589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e25e87-53e2-4dfa-a9c7-9d44d334abb6 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:05.321789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 723/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:07.559820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d2c6-1829-4c77-932d-ebc7a3762aac None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:07.560355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d2c6-1829-4c77-932d-ebc7a3762aac None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:07.560355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d2c6-1829-4c77-932d-ebc7a3762aac None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:07.561727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:07.567161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c331aa-a7da-4c8e-84de-becca2186995 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:07.567627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c331aa-a7da-4c8e-84de-becca2186995 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:07.567734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c331aa-a7da-4c8e-84de-becca2186995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:07.636363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b6c331aa-a7da-4c8e-84de-becca2186995 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:07.639791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b6c331aa-a7da-4c8e-84de-becca2186995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:07.668040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:07.735334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:08.018975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d2c6-1829-4c77-932d-ebc7a3762aac None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:08.020526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-69f1d2c6-1829-4c77-932d-ebc7a3762aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:08.121654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d2c6-1829-4c77-932d-ebc7a3762aac None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:08.149213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:08.194145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc3eba-0faa-4775-ac2d-96e7128a845e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:08.194674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3eba-0faa-4775-ac2d-96e7128a845e service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:08.194952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3eba-0faa-4775-ac2d-96e7128a845e service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:08.195224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3eba-0faa-4775-ac2d-96e7128a845e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:08.197456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c1bc3eba-0faa-4775-ac2d-96e7128a845e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:08.303461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc3eba-0faa-4775-ac2d-96e7128a845e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:08.304898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc3eba-0faa-4775-ac2d-96e7128a845e service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:08.324260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 734/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:10.532408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2b53b-4cca-4f05-a322-4815f37cbf88 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:10.542081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2b53b-4cca-4f05-a322-4815f37cbf88 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:10.542081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2b53b-4cca-4f05-a322-4815f37cbf88 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:10.542081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:10.542395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeedff5-c0f4-4c2b-97a9-ead2b1526035 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:10.542395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeedff5-c0f4-4c2b-97a9-ead2b1526035 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:10.542395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeedff5-c0f4-4c2b-97a9-ead2b1526035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:10.607018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-abeedff5-c0f4-4c2b-97a9-ead2b1526035 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:10.608246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-abeedff5-c0f4-4c2b-97a9-ead2b1526035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:10.616637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:10.703885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:10.999572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2b53b-4cca-4f05-a322-4815f37cbf88 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:11.001125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-49c2b53b-4cca-4f05-a322-4815f37cbf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:11.102633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2b53b-4cca-4f05-a322-4815f37cbf88 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:11.159569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:11.182961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6ae9d-452c-4a63-a290-e3d0cbab9381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:11.182961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ae9d-452c-4a63-a290-e3d0cbab9381 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:11.182961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ae9d-452c-4a63-a290-e3d0cbab9381 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:11.182961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6ae9d-452c-4a63-a290-e3d0cbab9381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:11.183514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d1a6ae9d-452c-4a63-a290-e3d0cbab9381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:11.289746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6ae9d-452c-4a63-a290-e3d0cbab9381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:11.291238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6ae9d-452c-4a63-a290-e3d0cbab9381 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:11.310133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 726/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:13.611863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e10cc3-28f7-4267-8b24-0bdcb89d1b88 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:13.612742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e10cc3-28f7-4267-8b24-0bdcb89d1b88 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:13.612742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e10cc3-28f7-4267-8b24-0bdcb89d1b88 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:13.614000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:13.619325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29485e-7238-49b0-8db8-4a589f5f3149 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:13.619811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29485e-7238-49b0-8db8-4a589f5f3149 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:13.619927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29485e-7238-49b0-8db8-4a589f5f3149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:13.687360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0e29485e-7238-49b0-8db8-4a589f5f3149 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:13.688586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0e29485e-7238-49b0-8db8-4a589f5f3149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:13.726157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:13.783885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:14.078328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e10cc3-28f7-4267-8b24-0bdcb89d1b88 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:14.079906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-59e10cc3-28f7-4267-8b24-0bdcb89d1b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:14.183285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e10cc3-28f7-4267-8b24-0bdcb89d1b88 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:14.220514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:14.256778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45289bd-db68-403a-a899-6764fc36feff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:14.257382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45289bd-db68-403a-a899-6764fc36feff service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:14.257659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45289bd-db68-403a-a899-6764fc36feff service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:14.257927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45289bd-db68-403a-a899-6764fc36feff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:14.259774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a45289bd-db68-403a-a899-6764fc36feff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:14.367140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45289bd-db68-403a-a899-6764fc36feff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:14.368530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45289bd-db68-403a-a899-6764fc36feff service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:14.386351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 737/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:16.543220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad5c5-94a6-4d41-ba7b-560ed8be7ccc None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:16.543820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad5c5-94a6-4d41-ba7b-560ed8be7ccc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:16.543820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad5c5-94a6-4d41-ba7b-560ed8be7ccc None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:16.545220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:16.550640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf332e56-3d88-4b25-967d-122b73f3c174 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:16.551081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf332e56-3d88-4b25-967d-122b73f3c174 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:16.551206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf332e56-3d88-4b25-967d-122b73f3c174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:16.616640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-cf332e56-3d88-4b25-967d-122b73f3c174 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:16.617838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cf332e56-3d88-4b25-967d-122b73f3c174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:16.636890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:16.713519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:16.998328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbad5c5-94a6-4d41-ba7b-560ed8be7ccc None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:16.999894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3fbad5c5-94a6-4d41-ba7b-560ed8be7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:17.103118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbad5c5-94a6-4d41-ba7b-560ed8be7ccc None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:17.170096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:17.179301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbf2d4-2360-48e3-8312-1b4155f71681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:17.179969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf2d4-2360-48e3-8312-1b4155f71681 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:17.180250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf2d4-2360-48e3-8312-1b4155f71681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:17.180521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbf2d4-2360-48e3-8312-1b4155f71681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:17.182727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-99fbf2d4-2360-48e3-8312-1b4155f71681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:17.293056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf2d4-2360-48e3-8312-1b4155f71681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:17.294477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbf2d4-2360-48e3-8312-1b4155f71681 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:17.312117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 729/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:19.521826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39645e-d3d3-4300-9d87-42129b62cb1e None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:19.522355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39645e-d3d3-4300-9d87-42129b62cb1e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:19.522481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39645e-d3d3-4300-9d87-42129b62cb1e None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:19.523884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:19.529309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84630d3f-2102-47f3-98cf-e0af54fec470 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:19.529776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84630d3f-2102-47f3-98cf-e0af54fec470 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:19.529927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84630d3f-2102-47f3-98cf-e0af54fec470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:19.597103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-84630d3f-2102-47f3-98cf-e0af54fec470 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:19.598309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-84630d3f-2102-47f3-98cf-e0af54fec470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:19.647150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:19.694806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:19.988146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39645e-d3d3-4300-9d87-42129b62cb1e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:19.989672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fa39645e-d3d3-4300-9d87-42129b62cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:20.092458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39645e-d3d3-4300-9d87-42129b62cb1e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:20.144070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:20.172850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4660d2b-88ae-402b-be40-1e16ecb87a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:20.173686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660d2b-88ae-402b-be40-1e16ecb87a90 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:20.173686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660d2b-88ae-402b-be40-1e16ecb87a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:20.174292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660d2b-88ae-402b-be40-1e16ecb87a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:20.175574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c4660d2b-88ae-402b-be40-1e16ecb87a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:20.284148 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4660d2b-88ae-402b-be40-1e16ecb87a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:20.285578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4660d2b-88ae-402b-be40-1e16ecb87a90 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:20.310237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 740/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:29.693300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=22 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:30.307906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=66 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:41.144391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db016b-01da-4037-86fb-8aece16f75d9 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:41.144925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db016b-01da-4037-86fb-8aece16f75d9 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:41.144925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db016b-01da-4037-86fb-8aece16f75d9 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:41.146287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 731/1471] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:41.152283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902413e-2388-4382-a932-7c3b75e5e4af None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:41.152731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902413e-2388-4382-a932-7c3b75e5e4af None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:41.152832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902413e-2388-4382-a932-7c3b75e5e4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:41.218885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e902413e-2388-4382-a932-7c3b75e5e4af None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:41.220035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e902413e-2388-4382-a932-7c3b75e5e4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:41.315881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 741/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:41.615703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39d74b-8d9e-4a4c-9607-c77e04865de2 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:41.615990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39d74b-8d9e-4a4c-9607-c77e04865de2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:41.616267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39d74b-8d9e-4a4c-9607-c77e04865de2 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:41.618372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 732/1473] 10.222.0.57 () {54 vars in 962 bytes} [Wed Sep 28 08:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:41.623533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef2090-4866-46e2-8f94-cddc729f8785 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:41.623824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef2090-4866-46e2-8f94-cddc729f8785 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:41.624102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef2090-4866-46e2-8f94-cddc729f8785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:41.701535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-edef2090-4866-46e2-8f94-cddc729f8785 None None] MFA Rules not processed for user `d0570ef979ab4073898635be3fbb8894`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:41.702737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-edef2090-4866-46e2-8f94-cddc729f8785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:41.722561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:41.777911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 742/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Sep 28 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:41.785581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39d74b-8d9e-4a4c-9607-c77e04865de2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:41.787071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fc39d74b-8d9e-4a4c-9607-c77e04865de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:41.889982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39d74b-8d9e-4a4c-9607-c77e04865de2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:41.963856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7002d-d825-4b39-bdb9-cda5b9458bf6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:41.964469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7002d-d825-4b39-bdb9-cda5b9458bf6 service glance] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:41.964745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7002d-d825-4b39-bdb9-cda5b9458bf6 service glance] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:41.965012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7002d-d825-4b39-bdb9-cda5b9458bf6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:41.966593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-34f7002d-d825-4b39-bdb9-cda5b9458bf6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:42.020026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:42.074646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7002d-d825-4b39-bdb9-cda5b9458bf6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:42.076162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7002d-d825-4b39-bdb9-cda5b9458bf6 service glance] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:42.094572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 733/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:44.341275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29080-4a57-44ed-87dd-4a99df950ac8 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:44.341878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29080-4a57-44ed-87dd-4a99df950ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:44.341878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29080-4a57-44ed-87dd-4a99df950ac8 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:44.343149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 743/1476] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:44.348487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4315-6bfe-4617-940d-f0e019439fc3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:44.348944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4315-6bfe-4617-940d-f0e019439fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:44.349059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4315-6bfe-4617-940d-f0e019439fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:44.416224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-368b4315-6bfe-4617-940d-f0e019439fc3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:44.417426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-368b4315-6bfe-4617-940d-f0e019439fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:44.513836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 734/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:44.787953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29080-4a57-44ed-87dd-4a99df950ac8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:44.790251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1fa29080-4a57-44ed-87dd-4a99df950ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:44.913495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29080-4a57-44ed-87dd-4a99df950ac8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:44.963149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:45.007206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca51b49-fbc4-4084-87e0-aa224ba546b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:45.008428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51b49-fbc4-4084-87e0-aa224ba546b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:45.008705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51b49-fbc4-4084-87e0-aa224ba546b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:45.009006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51b49-fbc4-4084-87e0-aa224ba546b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:45.009992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca51b49-fbc4-4084-87e0-aa224ba546b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:45.011398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-cca51b49-fbc4-4084-87e0-aa224ba546b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:43:45.011398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:43:45.011398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:43:45.012548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca51b49-fbc4-4084-87e0-aa224ba546b0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:45.031126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 744/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 28 08:43:44 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:43:47.201055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040a6aa-e958-4090-a788-54ef5595ed61 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:47.201585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040a6aa-e958-4090-a788-54ef5595ed61 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:47.201585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040a6aa-e958-4090-a788-54ef5595ed61 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:47.202864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 735/1479] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:47.208160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d218-b7c1-4a2a-9615-2107d3712155 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:47.208563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d218-b7c1-4a2a-9615-2107d3712155 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:47.208710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d218-b7c1-4a2a-9615-2107d3712155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:47.274510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-20d8d218-b7c1-4a2a-9615-2107d3712155 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:47.275729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-20d8d218-b7c1-4a2a-9615-2107d3712155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:47.371176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 745/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:47.666164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040a6aa-e958-4090-a788-54ef5595ed61 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:47.667694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5040a6aa-e958-4090-a788-54ef5595ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:47.677317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:47.811636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040a6aa-e958-4090-a788-54ef5595ed61 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:47.892225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:47.925494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd172ff-0900-417e-887b-3ad0684aed48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:47.925712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd172ff-0900-417e-887b-3ad0684aed48 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:47.925992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd172ff-0900-417e-887b-3ad0684aed48 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:47.926261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd172ff-0900-417e-887b-3ad0684aed48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:47.927867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5fd172ff-0900-417e-887b-3ad0684aed48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:48.015865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd172ff-0900-417e-887b-3ad0684aed48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:48.017437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd172ff-0900-417e-887b-3ad0684aed48 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:48.035695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 736/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:50.414870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cd025-c13c-4bb5-8181-6ecd781e8e23 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:50.415413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cd025-c13c-4bb5-8181-6ecd781e8e23 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:50.415413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cd025-c13c-4bb5-8181-6ecd781e8e23 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:50.416809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 746/1482] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:50.422127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1225-58a5-41a3-b50e-a806b49b4552 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:50.422547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1225-58a5-41a3-b50e-a806b49b4552 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:50.422676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1225-58a5-41a3-b50e-a806b49b4552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:50.489905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-703a1225-58a5-41a3-b50e-a806b49b4552 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:50.491118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-703a1225-58a5-41a3-b50e-a806b49b4552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:50.540853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:50.592580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 737/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:50.887008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cd025-c13c-4bb5-8181-6ecd781e8e23 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:50.888573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3e7cd025-c13c-4bb5-8181-6ecd781e8e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:50.914227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:50.996406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cd025-c13c-4bb5-8181-6ecd781e8e23 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:51.067175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcc09e-c424-409a-a3da-8090a0a144d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:51.067807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc09e-c424-409a-a3da-8090a0a144d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:51.068081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc09e-c424-409a-a3da-8090a0a144d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:51.068348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcc09e-c424-409a-a3da-8090a0a144d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:51.069908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-59bcc09e-c424-409a-a3da-8090a0a144d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:51.141423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:51.177736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcc09e-c424-409a-a3da-8090a0a144d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:51.179277 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcc09e-c424-409a-a3da-8090a0a144d5 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:51.197336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 747/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:53.417433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f8d1-0c03-4e5d-a51d-db65dcf0b57c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:53.418028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f8d1-0c03-4e5d-a51d-db65dcf0b57c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:53.418028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f8d1-0c03-4e5d-a51d-db65dcf0b57c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:53.419336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 738/1485] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:53.424847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d38c-d9b9-471e-bd87-a6ce37884aef None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:53.425284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d38c-d9b9-471e-bd87-a6ce37884aef None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:53.425391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d38c-d9b9-471e-bd87-a6ce37884aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:53.491111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c264d38c-d9b9-471e-bd87-a6ce37884aef None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:53.493085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c264d38c-d9b9-471e-bd87-a6ce37884aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:53.588969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 748/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:53.881093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f8d1-0c03-4e5d-a51d-db65dcf0b57c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:53.883276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-55b5f8d1-0c03-4e5d-a51d-db65dcf0b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:53.986635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f8d1-0c03-4e5d-a51d-db65dcf0b57c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:54.059636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:54.060994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d654ee-7e2a-4b4e-8120-8bdf4b9e15b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:54.061596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d654ee-7e2a-4b4e-8120-8bdf4b9e15b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:54.061874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d654ee-7e2a-4b4e-8120-8bdf4b9e15b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:54.062146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d654ee-7e2a-4b4e-8120-8bdf4b9e15b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:54.063733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-71d654ee-7e2a-4b4e-8120-8bdf4b9e15b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:54.172910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d654ee-7e2a-4b4e-8120-8bdf4b9e15b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:54.174262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d654ee-7e2a-4b4e-8120-8bdf4b9e15b8 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:54.192390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 739/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:56.438074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05ef6-8b7f-46b1-a4f9-d40cfd5f4c69 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:56.438647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05ef6-8b7f-46b1-a4f9-d40cfd5f4c69 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:56.438647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05ef6-8b7f-46b1-a4f9-d40cfd5f4c69 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:56.440001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 749/1488] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:56.445841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d35-0e66-4b7d-8d86-ec0646ab2a0a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:56.446247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d35-0e66-4b7d-8d86-ec0646ab2a0a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:56.446390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d35-0e66-4b7d-8d86-ec0646ab2a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:56.511607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-14bb7d35-0e66-4b7d-8d86-ec0646ab2a0a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:56.512797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-14bb7d35-0e66-4b7d-8d86-ec0646ab2a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:56.565685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:56.610122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 740/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:43:56.905862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b05ef6-8b7f-46b1-a4f9-d40cfd5f4c69 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:43:56.907460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e0b05ef6-8b7f-46b1-a4f9-d40cfd5f4c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:56.945159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:57.014801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b05ef6-8b7f-46b1-a4f9-d40cfd5f4c69 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:43:57.089248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450947-0dac-4e14-a03a-4ae0dc1d51e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:43:57.089851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450947-0dac-4e14-a03a-4ae0dc1d51e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:57.090133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450947-0dac-4e14-a03a-4ae0dc1d51e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:57.090408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450947-0dac-4e14-a03a-4ae0dc1d51e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:57.092022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9e450947-0dac-4e14-a03a-4ae0dc1d51e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:57.173152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:57.203144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450947-0dac-4e14-a03a-4ae0dc1d51e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:43:57.204666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e450947-0dac-4e14-a03a-4ae0dc1d51e6 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:43:57.222492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 750/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:43:59.773333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47ebd-f047-4cfb-bb24-49e51860acfe None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:59.773898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47ebd-f047-4cfb-bb24-49e51860acfe None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:59.773898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47ebd-f047-4cfb-bb24-49e51860acfe None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:59.775200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 741/1491] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 28 08:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:43:59.780477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4499-8737-460c-a878-020a731c203b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:43:59.780880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4499-8737-460c-a878-020a731c203b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:43:59.781230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4499-8737-460c-a878-020a731c203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:43:59.847234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f5ed4499-8737-460c-a878-020a731c203b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:43:59.848465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f5ed4499-8737-460c-a878-020a731c203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:43:59.952775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 751/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 28 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:44:00.242126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47ebd-f047-4cfb-bb24-49e51860acfe None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:44:00.243677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-03f47ebd-f047-4cfb-bb24-49e51860acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:44:00.344141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47ebd-f047-4cfb-bb24-49e51860acfe None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:44:00.416155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5676bae-ef7c-4cf8-bc24-8e14a47e1c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:44:00.416748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5676bae-ef7c-4cf8-bc24-8e14a47e1c94 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:44:00.417030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5676bae-ef7c-4cf8-bc24-8e14a47e1c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:44:00.417296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5676bae-ef7c-4cf8-bc24-8e14a47e1c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:44:00.418851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c5676bae-ef7c-4cf8-bc24-8e14a47e1c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:44:00.427139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:00.525271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5676bae-ef7c-4cf8-bc24-8e14a47e1c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:44:00.526689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5676bae-ef7c-4cf8-bc24-8e14a47e1c94 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:44:00.544591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 742/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:44:09.951226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=82 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:10.542380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=50 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:44.943664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422f503-e8d3-4537-a7a5-a2ca724fc88e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:44.944121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422f503-e8d3-4537-a7a5-a2ca724fc88e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:44.944220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422f503-e8d3-4537-a7a5-a2ca724fc88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.024464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0422f503-e8d3-4537-a7a5-a2ca724fc88e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:45:45.025655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0422f503-e8d3-4537-a7a5-a2ca724fc88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:45:45.127715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 752/1494] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:45:45.135556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04728d77-d6af-4bd4-b9da-68d8e1f6983b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.136038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04728d77-d6af-4bd4-b9da-68d8e1f6983b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.136351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04728d77-d6af-4bd4-b9da-68d8e1f6983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.156452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-04728d77-d6af-4bd4-b9da-68d8e1f6983b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:45:45.157631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-04728d77-d6af-4bd4-b9da-68d8e1f6983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:45:45.165975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 743/1495] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:45:45.170641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422f503-e8d3-4537-a7a5-a2ca724fc88e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:45.180523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422f503-e8d3-4537-a7a5-a2ca724fc88e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:45.186212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:45.186805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.187077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.187345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.188022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:45:45.188315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:45.189319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:45.189319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:45:45.189319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:45:45.190200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:45.202322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 753/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:45:45.210394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04728d77-d6af-4bd4-b9da-68d8e1f6983b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:45.219490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04728d77-d6af-4bd4-b9da-68d8e1f6983b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:45.224214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:45.224813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.225091 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.225359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.225990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:45.227710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING py.warnings [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:45.227710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: warnings.warn(msg) Sep 28 08:45:45.227710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: Sep 28 08:45:45.228922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:45.337514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 744/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:45:45 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:45:45.342008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:45.352707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5fb90-07e3-4560-a7f7-9a88bf12af90 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:45.411934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:45.419098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:45.419754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.420033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.420303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.420950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:45.421972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:45.421972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:45:45.421972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:45:45.423215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:45.523488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 754/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:45:45 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:45:45.527672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:45.538011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6772-02a6-49f5-b148-daf263fc125d admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:45.543144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:45.579355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.579355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.579355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.579355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:45.579355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING py.warnings [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:45.579355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: warnings.warn(msg) Sep 28 08:45:45.579355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: Sep 28 08:45:45.580098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:45.580098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 745/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:45:45.582427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:45.592734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4179-ea48-47aa-bc5e-715a211bec38 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:45.597264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501183b8-e833-4b8c-b3ac-4beab77314f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:45.597852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501183b8-e833-4b8c-b3ac-4beab77314f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.598128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501183b8-e833-4b8c-b3ac-4beab77314f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.598399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501183b8-e833-4b8c-b3ac-4beab77314f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.599031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501183b8-e833-4b8c-b3ac-4beab77314f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:45.600064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-501183b8-e833-4b8c-b3ac-4beab77314f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:45.600064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:45:45.600064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:45:45.600933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501183b8-e833-4b8c-b3ac-4beab77314f8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:45.614802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 755/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:45:45.619185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:45.629946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd65a98-0a97-4364-8f61-beaf0e36e7bc admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:45.634640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9205149-5937-41fc-bdcd-9798dca30cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:45.635283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9205149-5937-41fc-bdcd-9798dca30cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.635586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9205149-5937-41fc-bdcd-9798dca30cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.635857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9205149-5937-41fc-bdcd-9798dca30cd8 admin admin] PATH_INFO: `/v3/projects/706c4fe156724d829b0b05611a1eee3d/users/50f48127729349e08f3771832480f314/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.651001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9205149-5937-41fc-bdcd-9798dca30cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706c4fe156724d829b0b05611a1eee3d, user_id=50f48127729349e08f3771832480f314, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:45.652050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING py.warnings [None req-d9205149-5937-41fc-bdcd-9798dca30cd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:45.652050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: warnings.warn(msg) Sep 28 08:45:45.652050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: Sep 28 08:45:45.654220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9205149-5937-41fc-bdcd-9798dca30cd8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:45.711474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 746/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:45:45 2022] PUT /identity/v3/projects/706c4fe156724d829b0b05611a1eee3d/users/50f48127729349e08f3771832480f314/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:45:45.724337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc63a4-9b82-4180-8034-0bf4079255cf None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.724611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc63a4-9b82-4180-8034-0bf4079255cf None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.724885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc63a4-9b82-4180-8034-0bf4079255cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.753852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-dfdc63a4-9b82-4180-8034-0bf4079255cf None None] MFA Rules not processed for user `50f48127729349e08f3771832480f314`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:45:45.755051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-dfdc63a4-9b82-4180-8034-0bf4079255cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:45:45.820729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 756/1502] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:45:45.834219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66333-86b7-46c0-98ea-a182913108ce None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.837669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66333-86b7-46c0-98ea-a182913108ce None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.837669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66333-86b7-46c0-98ea-a182913108ce None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.837669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 747/1503] 10.222.0.57 () {54 vars in 963 bytes} [Wed Sep 28 08:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:45:45.841076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4250b-bb3e-4024-adf1-0ca8f8ac360a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:45.841361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4250b-bb3e-4024-adf1-0ca8f8ac360a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:45.841656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4250b-bb3e-4024-adf1-0ca8f8ac360a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:45.900434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b6a4250b-bb3e-4024-adf1-0ca8f8ac360a None None] MFA Rules not processed for user `d053a3f1d07641b586518ae0c0a39e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:45:45.901633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b6a4250b-bb3e-4024-adf1-0ca8f8ac360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:45:45.977566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 757/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Wed Sep 28 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:45:45.986213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66333-86b7-46c0-98ea-a182913108ce None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:45.996667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66333-86b7-46c0-98ea-a182913108ce None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:46.000133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:46.000723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:46.001004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:46.001278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:46.009226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:46.010628 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:46.019170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 748/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:45:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:45:46.064803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d874c-9a87-4fd2-9eb9-6d243e7043f6 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:46.065123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d874c-9a87-4fd2-9eb9-6d243e7043f6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:46.065398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d874c-9a87-4fd2-9eb9-6d243e7043f6 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:46.066686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 758/1506] 10.222.0.57 () {52 vars in 830 bytes} [Wed Sep 28 08:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:45:46.070133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:46.134444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766dc82-a14a-41a0-ae91-bfc21e93cfef service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:46.139143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:46.139800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:46.140080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:46.140353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] PATH_INFO: `/v3/users/50f48127729349e08f3771832480f314` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:46.141487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f48127729349e08f3771832480f314)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:46.142487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING py.warnings [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:46.142487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: warnings.warn(msg) Sep 28 08:45:46.142487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: Sep 28 08:45:46.143735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:46.378158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f48127729349e08f3771832480f314'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:46.378785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f48127729349e08f3771832480f314'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:46.403205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f48127729349e08f3771832480f314'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:46.483745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f48127729349e08f3771832480f314'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:46.484475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f48127729349e08f3771832480f314'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:46.497135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:46.505866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 749/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:45:46 2022] DELETE /identity/v3/users/50f48127729349e08f3771832480f314 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:45:46.510176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:46.510465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:46.510738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:46.530645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:45:46.535632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:45:46.540818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:46.590135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 759/1508] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:45:46.599716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:46.601157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:45:46.678534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247397b-07c4-48d0-98ab-b2492cd8287a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:46.682067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa81f3-76d6-4fb0-bf3f-333569fb78f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:46.682672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa81f3-76d6-4fb0-bf3f-333569fb78f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:46.683480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa81f3-76d6-4fb0-bf3f-333569fb78f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:46.683855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa81f3-76d6-4fb0-bf3f-333569fb78f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:46.692612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa81f3-76d6-4fb0-bf3f-333569fb78f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:46.694080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa81f3-76d6-4fb0-bf3f-333569fb78f7 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:46.704025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 750/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:45:47.126133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:45:47.127624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:45:47.139636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f011e-24b1-48c1-be43-3b31573d67f4 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:45:47.144157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:45:47.144954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:45:47.145239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:45:47.145516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] PATH_INFO: `/v3/projects/706c4fe156724d829b0b05611a1eee3d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:45:47.146642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706c4fe156724d829b0b05611a1eee3d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:45:47.147785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:45:47.147785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:45:47.147785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:45:47.148912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:45:47.255746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706c4fe156724d829b0b05611a1eee3d', 'request_id': 'req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:47.268606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706c4fe156724d829b0b05611a1eee3d', 'request_id': 'req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:47.351669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706c4fe156724d829b0b05611a1eee3d', 'request_id': 'req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:47.364164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] The token cache is being invalidate because project 706c4fe156724d829b0b05611a1eee3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:45:47.364456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:47.365080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-79da5b74-65e1-4af1-9789-5d9c3fa1ab97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:45:47.366697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 760/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:45:47 2022] DELETE /identity/v3/projects/706c4fe156724d829b0b05611a1eee3d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:45:56.705610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=38 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:57.360998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:20.397124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60930-1cae-42f8-87d0-2946d2b05f99 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:20.397716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60930-1cae-42f8-87d0-2946d2b05f99 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:20.397716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60930-1cae-42f8-87d0-2946d2b05f99 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:20.399043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:20.404463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b13b77-df03-4126-a307-203e41e6413b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:20.404915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b13b77-df03-4126-a307-203e41e6413b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:20.405014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b13b77-df03-4126-a307-203e41e6413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:20.424871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-79b13b77-df03-4126-a307-203e41e6413b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:20.426049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-79b13b77-df03-4126-a307-203e41e6413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:20.484170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:20.638493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f60930-1cae-42f8-87d0-2946d2b05f99 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:20.640198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-28f60930-1cae-42f8-87d0-2946d2b05f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:20.742549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f60930-1cae-42f8-87d0-2946d2b05f99 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:20.747940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae67fb-e651-449f-baba-afe8e640b3fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:20.748545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae67fb-e651-449f-baba-afe8e640b3fc service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:20.748827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae67fb-e651-449f-baba-afe8e640b3fc service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:20.749103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae67fb-e651-449f-baba-afe8e640b3fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:20.757379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae67fb-e651-449f-baba-afe8e640b3fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:20.759517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae67fb-e651-449f-baba-afe8e640b3fc service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:20.768982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 752/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:21.858713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff0a0-8e28-4afd-b7f4-f098c3a45272 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:21.859268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff0a0-8e28-4afd-b7f4-f098c3a45272 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:21.859268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff0a0-8e28-4afd-b7f4-f098c3a45272 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:21.860699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:21.866643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848948d8-b0df-42da-a7a4-e79dbaee7a0c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:21.867083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848948d8-b0df-42da-a7a4-e79dbaee7a0c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:21.867257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848948d8-b0df-42da-a7a4-e79dbaee7a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:21.887286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-848948d8-b0df-42da-a7a4-e79dbaee7a0c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:21.888524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-848948d8-b0df-42da-a7a4-e79dbaee7a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:21.896232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:22.047315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff0a0-8e28-4afd-b7f4-f098c3a45272 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:22.062287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff0a0-8e28-4afd-b7f4-f098c3a45272 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:22.068840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c9be2-b612-465b-a8e4-74bd65a4d6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:22.069460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9be2-b612-465b-a8e4-74bd65a4d6c8 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:22.069738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9be2-b612-465b-a8e4-74bd65a4d6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:22.070009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9be2-b612-465b-a8e4-74bd65a4d6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:22.078785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c9be2-b612-465b-a8e4-74bd65a4d6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:22.080394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c9be2-b612-465b-a8e4-74bd65a4d6c8 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:22.089605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 763/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:22.410136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40167e5-4156-4ec9-b9ab-cebf761eb851 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:22.410348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40167e5-4156-4ec9-b9ab-cebf761eb851 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:22.410595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40167e5-4156-4ec9-b9ab-cebf761eb851 None None] PATH_INFO: `/v3` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:22.411962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 754/1517] 10.222.0.49 () {54 vars in 925 bytes} [Wed Sep 28 08:47:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:47:22.418876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8696-70c6-47a5-81d0-d7238006cee1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:22.419163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8696-70c6-47a5-81d0-d7238006cee1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:22.419501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8696-70c6-47a5-81d0-d7238006cee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:22.469225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-256f8696-70c6-47a5-81d0-d7238006cee1 None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:22.470416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-256f8696-70c6-47a5-81d0-d7238006cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:22.545268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 764/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Sep 28 08:47:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:26.384204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb7c23-2197-44c8-9b82-c133ab2c7ed1 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:26.385379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb7c23-2197-44c8-9b82-c133ab2c7ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:26.385379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb7c23-2197-44c8-9b82-c133ab2c7ed1 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:26.386630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 755/1519] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 28 08:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:26.391729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa098ce-7847-46b3-85e1-5ffcdb07de87 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:26.392158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa098ce-7847-46b3-85e1-5ffcdb07de87 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:26.398916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa098ce-7847-46b3-85e1-5ffcdb07de87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:26.412015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0aa098ce-7847-46b3-85e1-5ffcdb07de87 None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:26.413206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0aa098ce-7847-46b3-85e1-5ffcdb07de87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:26.421613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 765/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 28 08:47:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:26.429102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb7c23-2197-44c8-9b82-c133ab2c7ed1 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:26.442708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb7c23-2197-44c8-9b82-c133ab2c7ed1 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:26.448401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f24e1d-bb2f-4f7e-9f94-18a480f03bfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:26.448987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24e1d-bb2f-4f7e-9f94-18a480f03bfd service placement] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:26.449260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24e1d-bb2f-4f7e-9f94-18a480f03bfd service placement] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:26.449530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24e1d-bb2f-4f7e-9f94-18a480f03bfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:26.457457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f24e1d-bb2f-4f7e-9f94-18a480f03bfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:26.458994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f24e1d-bb2f-4f7e-9f94-18a480f03bfd service placement] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:26.468566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 756/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:33.623326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ceae-9f38-4601-953a-acf9b584982b None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:33.623894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ceae-9f38-4601-953a-acf9b584982b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:33.623894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2ceae-9f38-4601-953a-acf9b584982b None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:33.625284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:33.631451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3069-d7f1-4691-bd9d-b67918658d49 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:33.631884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3069-d7f1-4691-bd9d-b67918658d49 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:33.632075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3069-d7f1-4691-bd9d-b67918658d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:33.652221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3a2a3069-d7f1-4691-bd9d-b67918658d49 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:33.653403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3a2a3069-d7f1-4691-bd9d-b67918658d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:33.661004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:33.812630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2ceae-9f38-4601-953a-acf9b584982b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:33.827701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2ceae-9f38-4601-953a-acf9b584982b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:33.833068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37c931-c2ad-40a0-af2a-80e53728b815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:33.833664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c931-c2ad-40a0-af2a-80e53728b815 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:33.833946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c931-c2ad-40a0-af2a-80e53728b815 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:33.834219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37c931-c2ad-40a0-af2a-80e53728b815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:33.843021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c931-c2ad-40a0-af2a-80e53728b815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:33.844652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37c931-c2ad-40a0-af2a-80e53728b815 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:33.854526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 767/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:34.933663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91f6e-d449-4e0c-8fe9-46c55e16bf95 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:34.934127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91f6e-d449-4e0c-8fe9-46c55e16bf95 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:34.934224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91f6e-d449-4e0c-8fe9-46c55e16bf95 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:34.935643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 28 08:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:47:34.941762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87a450-1073-487c-a004-3ed1705ca28c None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:34.942209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87a450-1073-487c-a004-3ed1705ca28c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:34.942314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87a450-1073-487c-a004-3ed1705ca28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:34.963969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0f87a450-1073-487c-a004-3ed1705ca28c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:34.965144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0f87a450-1073-487c-a004-3ed1705ca28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:34.972834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 28 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:35.125848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91f6e-d449-4e0c-8fe9-46c55e16bf95 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:35.140341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91f6e-d449-4e0c-8fe9-46c55e16bf95 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:35.145762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681ec82-e3f8-475e-93d0-8c4fbc0aef8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:35.146389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681ec82-e3f8-475e-93d0-8c4fbc0aef8d service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:35.146670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681ec82-e3f8-475e-93d0-8c4fbc0aef8d service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:35.146946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681ec82-e3f8-475e-93d0-8c4fbc0aef8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:35.155101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681ec82-e3f8-475e-93d0-8c4fbc0aef8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:35.156683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681ec82-e3f8-475e-93d0-8c4fbc0aef8d service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:35.166553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 759/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:39.254490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd51a1-a42f-4744-a59e-80634179d001 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:39.255023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd51a1-a42f-4744-a59e-80634179d001 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:39.255023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd51a1-a42f-4744-a59e-80634179d001 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:39.256478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:39.262476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f8ec9-a537-4fe6-8480-cdac367cb9d4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:39.262919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f8ec9-a537-4fe6-8480-cdac367cb9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:39.263030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f8ec9-a537-4fe6-8480-cdac367cb9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:39.282275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-478f8ec9-a537-4fe6-8480-cdac367cb9d4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:39.283489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-478f8ec9-a537-4fe6-8480-cdac367cb9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:39.291289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:47:39.586704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd51a1-a42f-4744-a59e-80634179d001 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:39.588669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e1fd51a1-a42f-4744-a59e-80634179d001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:39.617980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:39.647784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd51a1-a42f-4744-a59e-80634179d001 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:39.651523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126294a2-88c8-4471-b09e-70926afbfd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:39.652127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126294a2-88c8-4471-b09e-70926afbfd62 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:39.652405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126294a2-88c8-4471-b09e-70926afbfd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:39.652677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126294a2-88c8-4471-b09e-70926afbfd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:39.662196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126294a2-88c8-4471-b09e-70926afbfd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:39.663656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126294a2-88c8-4471-b09e-70926afbfd62 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:39.673385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 770/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:41.838387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64296a-0ed8-46a2-adef-a5826ceb01d8 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:41.838977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64296a-0ed8-46a2-adef-a5826ceb01d8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:41.838977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64296a-0ed8-46a2-adef-a5826ceb01d8 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:41.840297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:41.845615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3c889-34e8-4e4c-9c58-2b1d1f109696 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:41.846044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3c889-34e8-4e4c-9c58-2b1d1f109696 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:41.846145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3c889-34e8-4e4c-9c58-2b1d1f109696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:41.866231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-2bb3c889-34e8-4e4c-9c58-2b1d1f109696 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:41.867401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2bb3c889-34e8-4e4c-9c58-2b1d1f109696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:41.876177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:42.166021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64296a-0ed8-46a2-adef-a5826ceb01d8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:42.176680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64296a-0ed8-46a2-adef-a5826ceb01d8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:42.180418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b383dbe-6564-4d9c-9c21-c843e6cdfbf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:42.181587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b383dbe-6564-4d9c-9c21-c843e6cdfbf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:42.181865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b383dbe-6564-4d9c-9c21-c843e6cdfbf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:42.182139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b383dbe-6564-4d9c-9c21-c843e6cdfbf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:42.190893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b383dbe-6564-4d9c-9c21-c843e6cdfbf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:42.192335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b383dbe-6564-4d9c-9c21-c843e6cdfbf5 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:42.202221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 762/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:45.853662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d773-ce01-4416-a4a4-c42f5a30ee6b None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:45.854242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d773-ce01-4416-a4a4-c42f5a30ee6b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:45.854242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d773-ce01-4416-a4a4-c42f5a30ee6b None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:45.855550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:45.860816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719cbdc-76af-474e-aa94-a64127f389b8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:45.861241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719cbdc-76af-474e-aa94-a64127f389b8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:45.861347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719cbdc-76af-474e-aa94-a64127f389b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:45.882234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f719cbdc-76af-474e-aa94-a64127f389b8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:45.883467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f719cbdc-76af-474e-aa94-a64127f389b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:45.891070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:46.198321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56d773-ce01-4416-a4a4-c42f5a30ee6b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:46.199987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4c56d773-ce01-4416-a4a4-c42f5a30ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:46.256624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56d773-ce01-4416-a4a4-c42f5a30ee6b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:46.260708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc088c-ede1-4583-a30f-ad731c2aed9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:46.261307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc088c-ede1-4583-a30f-ad731c2aed9e service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:46.261584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc088c-ede1-4583-a30f-ad731c2aed9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:46.261858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc088c-ede1-4583-a30f-ad731c2aed9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:46.270546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc088c-ede1-4583-a30f-ad731c2aed9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:46.271999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc088c-ede1-4583-a30f-ad731c2aed9e service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:46.281788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 773/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:48.413362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e966-d7d2-412d-a401-40d3202d28de None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:48.413926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e966-d7d2-412d-a401-40d3202d28de None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:48.413926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e966-d7d2-412d-a401-40d3202d28de None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:48.415279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 28 08:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:47:48.420640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca64ef6-d933-4856-8709-b4816b96711e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:48.421070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca64ef6-d933-4856-8709-b4816b96711e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:48.421178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca64ef6-d933-4856-8709-b4816b96711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:48.440932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4ca64ef6-d933-4856-8709-b4816b96711e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:47:48.442099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4ca64ef6-d933-4856-8709-b4816b96711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:48.450376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 28 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:47:48.759983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e966-d7d2-412d-a401-40d3202d28de None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:47:48.761719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-aec5e966-d7d2-412d-a401-40d3202d28de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:47:48.769401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=77 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:48.775559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e966-d7d2-412d-a401-40d3202d28de None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:47:48.778849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51177fda-d424-428d-9540-58a2a9e17a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:47:48.779474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177fda-d424-428d-9540-58a2a9e17a67 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:47:48.779758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177fda-d424-428d-9540-58a2a9e17a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:47:48.780032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177fda-d424-428d-9540-58a2a9e17a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:47:48.788799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51177fda-d424-428d-9540-58a2a9e17a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:47:48.790719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51177fda-d424-428d-9540-58a2a9e17a67 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:47:48.800295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 765/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:47:58.436267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=47 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:58.863253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:17.722917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934f47-9041-4311-96a5-673fd81fe682 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.724834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934f47-9041-4311-96a5-673fd81fe682 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.724834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934f47-9041-4311-96a5-673fd81fe682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.762177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a0934f47-9041-4311-96a5-673fd81fe682 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.763820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a0934f47-9041-4311-96a5-673fd81fe682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.775306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 775/1540] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:17.781462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a310e-87d1-423b-8fba-1aa3a5f38560 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.782040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a310e-87d1-423b-8fba-1aa3a5f38560 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.782040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a310e-87d1-423b-8fba-1aa3a5f38560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.806424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-210a310e-87d1-423b-8fba-1aa3a5f38560 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.807041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826f51-1137-4104-af28-9bf94cee8992 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.807604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826f51-1137-4104-af28-9bf94cee8992 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.807731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-210a310e-87d1-423b-8fba-1aa3a5f38560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.808250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826f51-1137-4104-af28-9bf94cee8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.824864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 766/1541] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:17.835279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b7826f51-1137-4104-af28-9bf94cee8992 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.843455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b7826f51-1137-4104-af28-9bf94cee8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.853853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758ec86-23bc-49a1-ad32-da8f02fff0eb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.854190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758ec86-23bc-49a1-ad32-da8f02fff0eb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.854407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758ec86-23bc-49a1-ad32-da8f02fff0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.864808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 776/1542] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:17.866417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24a91-c1fb-4c9b-a6e2-191ecb251432 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.866936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24a91-c1fb-4c9b-a6e2-191ecb251432 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.867474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24a91-c1fb-4c9b-a6e2-191ecb251432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.885054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2758ec86-23bc-49a1-ad32-da8f02fff0eb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.886270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2758ec86-23bc-49a1-ad32-da8f02fff0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.901473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-14f24a91-c1fb-4c9b-a6e2-191ecb251432 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.902668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-14f24a91-c1fb-4c9b-a6e2-191ecb251432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.910618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 767/1543] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:17.911499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758ec86-23bc-49a1-ad32-da8f02fff0eb None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:17.923238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 777/1544] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:17.923478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758ec86-23bc-49a1-ad32-da8f02fff0eb None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:17.923587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503a03b-1e7c-4f03-a3b2-df4174e5f5ae None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.923587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503a03b-1e7c-4f03-a3b2-df4174e5f5ae None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.923587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503a03b-1e7c-4f03-a3b2-df4174e5f5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.932494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:17.933113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.933581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.934028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.934681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:17.934983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:17.936016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING py.warnings [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:49:17.936016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: warnings.warn(msg) Sep 28 08:49:17.936016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: Sep 28 08:49:17.936897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74523168-050d-485e-86c4-657fd5d11b64 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:17.944319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e503a03b-1e7c-4f03-a3b2-df4174e5f5ae None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.945511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e503a03b-1e7c-4f03-a3b2-df4174e5f5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.949377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 768/1545] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:17.950585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e256c24-4035-4a98-99a0-f4a5d8c936a9 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.950942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e256c24-4035-4a98-99a0-f4a5d8c936a9 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.951139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e256c24-4035-4a98-99a0-f4a5d8c936a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.954686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 778/1546] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:17.955875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a1de-e01f-40a7-893c-908f0b1aaa40 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.956161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a1de-e01f-40a7-893c-908f0b1aaa40 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.956438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783a1de-e01f-40a7-893c-908f0b1aaa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:17.978908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e783a1de-e01f-40a7-893c-908f0b1aaa40 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.979119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2e256c24-4035-4a98-99a0-f4a5d8c936a9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:17.980048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e783a1de-e01f-40a7-893c-908f0b1aaa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.980336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2e256c24-4035-4a98-99a0-f4a5d8c936a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:17.988093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 769/1547] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:17.988616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 779/1548] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:17.997130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783a1de-e01f-40a7-893c-908f0b1aaa40 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:17.997324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f153d-963f-4088-abaf-be574d9d183a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:17.997324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f153d-963f-4088-abaf-be574d9d183a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:17.997502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f153d-963f-4088-abaf-be574d9d183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.009687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783a1de-e01f-40a7-893c-908f0b1aaa40 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.014252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.014858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.015137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.015409 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.016081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:18.016384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.017870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b44f153d-963f-4088-abaf-be574d9d183a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.018002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.019049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b44f153d-963f-4088-abaf-be574d9d183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.027255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 770/1549] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.028524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b1c0-ba82-4d49-9e18-dc655c5935c8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.028805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b1c0-ba82-4d49-9e18-dc655c5935c8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.029078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b1c0-ba82-4d49-9e18-dc655c5935c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.034343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 780/1550] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:18.034343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.042362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64d73c-53be-4a4a-9e99-5ab8e7f25106 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.047000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69f763-89f9-4ec4-9890-086b35e5d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.047621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f763-89f9-4ec4-9890-086b35e5d1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.047907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f763-89f9-4ec4-9890-086b35e5d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.048182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69f763-89f9-4ec4-9890-086b35e5d1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.048837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69f763-89f9-4ec4-9890-086b35e5d1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.049850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-9d69f763-89f9-4ec4-9890-086b35e5d1a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:49:18.049850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:49:18.049850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:49:18.051038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69f763-89f9-4ec4-9890-086b35e5d1a8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.054896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-afd8b1c0-ba82-4d49-9e18-dc655c5935c8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.056727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-afd8b1c0-ba82-4d49-9e18-dc655c5935c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.064576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 771/1551] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.065814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b44a-a769-4d89-92d7-f320e98adf6d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.066106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b44a-a769-4d89-92d7-f320e98adf6d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.066383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b44a-a769-4d89-92d7-f320e98adf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.088094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ab84b44a-a769-4d89-92d7-f320e98adf6d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.089359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ab84b44a-a769-4d89-92d7-f320e98adf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.097133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 772/1552] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.098291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8ff3-ab03-401d-9bde-b2a44113f3cb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.098575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8ff3-ab03-401d-9bde-b2a44113f3cb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.098851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe8ff3-ab03-401d-9bde-b2a44113f3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.119224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-fbbe8ff3-ab03-401d-9bde-b2a44113f3cb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.120440 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fbbe8ff3-ab03-401d-9bde-b2a44113f3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.128535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 773/1553] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.129860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038487a1-c0df-44c1-87e0-eadadd7edeaa None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.130148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038487a1-c0df-44c1-87e0-eadadd7edeaa None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.130423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038487a1-c0df-44c1-87e0-eadadd7edeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.149399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-038487a1-c0df-44c1-87e0-eadadd7edeaa None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.150542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-038487a1-c0df-44c1-87e0-eadadd7edeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.158103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 774/1554] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.161663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eaae5-1801-4ea3-80ae-0f3fb406508a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.161663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eaae5-1801-4ea3-80ae-0f3fb406508a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.161663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eaae5-1801-4ea3-80ae-0f3fb406508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.175461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 781/1555] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.175461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dca8f-fe30-4072-96b6-38f95b982df1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.175461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dca8f-fe30-4072-96b6-38f95b982df1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.175461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dca8f-fe30-4072-96b6-38f95b982df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.182208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-709eaae5-1801-4ea3-80ae-0f3fb406508a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.183475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-709eaae5-1801-4ea3-80ae-0f3fb406508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.197174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-5a8dca8f-fe30-4072-96b6-38f95b982df1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.198420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5a8dca8f-fe30-4072-96b6-38f95b982df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.244218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 775/1556] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.245051 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eaae5-1801-4ea3-80ae-0f3fb406508a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.255826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eaae5-1801-4ea3-80ae-0f3fb406508a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.261067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.261656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.261936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.262210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.262719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 782/1557] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.262817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.264756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.267046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dca8f-fe30-4072-96b6-38f95b982df1 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.276577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dca8f-fe30-4072-96b6-38f95b982df1 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.281210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.281803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.282086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.282361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.283004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:18.283308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.284942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.296592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 783/1558] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:18.297385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.307304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc42c86-a684-4d98-80b2-592dd4143332 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.311842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.312438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.312719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.312993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.313616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:18.313915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.315492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.327997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 784/1559] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:18.328783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.338510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ea199-6bc6-4b3b-9e96-badec67a11df admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.343000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.343615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.343898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.344012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 776/1560] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.344169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.344724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.344845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:18.345084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.346655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.360426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 785/1561] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:18.361067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.371100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ff14-7505-473f-afe1-7415dc02e49d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.416580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6992ca9-4e2a-493f-8a53-81c0e2e41d74 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.419859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:18.421205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f575ab4-7455-4b76-ab35-efd19337f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.421802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f575ab4-7455-4b76-ab35-efd19337f84c admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.422205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f575ab4-7455-4b76-ab35-efd19337f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.422331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f575ab4-7455-4b76-ab35-efd19337f84c admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.422981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f575ab4-7455-4b76-ab35-efd19337f84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:18.423274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f575ab4-7455-4b76-ab35-efd19337f84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.424890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f575ab4-7455-4b76-ab35-efd19337f84c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.428922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.434259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.434259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.434259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.434259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.434259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.438126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 777/1562] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:18.445539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b738-06e6-474e-a7a0-3ec5ada4dc10 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.445539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b738-06e6-474e-a7a0-3ec5ada4dc10 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.445539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b738-06e6-474e-a7a0-3ec5ada4dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.455184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:18.460704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5415b738-06e6-474e-a7a0-3ec5ada4dc10 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:18.462201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5415b738-06e6-474e-a7a0-3ec5ada4dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:18.470006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 778/1563] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:18.470903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415b738-06e6-474e-a7a0-3ec5ada4dc10 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.480775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415b738-06e6-474e-a7a0-3ec5ada4dc10 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.485247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.485853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.486092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.486363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.486990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:18.493313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.493313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.500952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 779/1564] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:18.501666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.511841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30fa7b-44b6-4137-a0c9-c910dd46dfb0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.516385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.516978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.517253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.517524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.518175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.518648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 786/1565] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.519467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.520356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.529666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd073f-8853-41cb-ada0-e0ba838609e7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.534313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.534905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.535187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.535482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.536108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.537991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.610846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 780/1566] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.611776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.642768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 787/1567] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.642768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.675491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eed88-84b0-4461-a967-cc394d04ddac admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.705326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667329f-f129-4574-9e8a-92b4b0fd52ac admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.709985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.710584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.710859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.711128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.711860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.713776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.733043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.733651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.733958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.734228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.734851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.735875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING py.warnings [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:49:18.735875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: warnings.warn(msg) Sep 28 08:49:18.735875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: Sep 28 08:49:18.737070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.822255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 788/1568] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.823162 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.851290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 781/1569] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.852978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.863404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f5536-bddd-40b0-99ec-5572a81b362e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.885105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8f341-3aff-4550-a8b8-9de33d5f179d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.889928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.890532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.890810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.891076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.891727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.893618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.922835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.923484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.923839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.924121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.924780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:18.925101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.926677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.929096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:18.939640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 782/1570] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:18.940424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:18.950500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1bed-6615-4a5e-b902-ed3d23815f66 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:18.955264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:18.955885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:18.956186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:18.956454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:18.957089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:18.958969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:18.972357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 789/1571] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:18.973331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.009950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:19.038675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a05073-3ead-46d5-bba5-b78bdcd7100c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.044086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.044738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.045014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.045279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.045908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.047548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.057745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 790/1572] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.058564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.067671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8a6b-226e-4e32-b589-af4e48d7ea90 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.072828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.073327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.073603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.073982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.074519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.076545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.076671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 783/1573] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:18 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.077229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.139083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219eda5-96d9-4570-a649-742eba19a9a1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.143693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.144292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.144569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.144838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.145455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.147340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.156620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 791/1574] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.156620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.164993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ceb78-71be-42a2-a260-906302821605 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.169832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.170408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.170684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.170953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.171595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.173486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.234341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 784/1575] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.235170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.244991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ede59e-eede-4ac8-89d9-ced92ed9686a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.249551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.250133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.250416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.250690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.251316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.252939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.265283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 792/1576] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.265484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 785/1577] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.265588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.265682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.275924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be228b-b0cd-428c-bd8d-06c2f163ab4e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.276905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b5f71-783c-45cc-843e-ffd81ed7bea2 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.280787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.281393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.281527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.281736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.282121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.282398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.282507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.282669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.283152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.283330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.285081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.285229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.376718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 786/1578] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.377474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.387906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8afbe6-b1f7-4b70-befa-d62707eda2a0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.392517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.393109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.393395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.393671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.394311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.395970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.401359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 793/1579] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.402174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.407902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 787/1580] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.408795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.418995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079726b-cdee-49db-862a-3067dcc8b92f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.468663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ce13b-4a80-413f-a46d-ab6359769a74 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.473250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.474568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.474568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.474765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.475239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.477739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.477983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.478591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.478869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.479139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.479913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.481502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.491817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 788/1581] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.500745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.503177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0168-6fba-40e5-9acc-35dfb72a236c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.509261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.509882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.510164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.510439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.511218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.512901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.523169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 789/1582] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.524642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.534342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afee4e-c3f5-4a81-820a-f0aa672e3a1b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.539106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.540259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.540541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.540841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.541469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.543041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.545068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:19.556405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 790/1583] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.556405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.563554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57e4b7-b047-4feb-b1ed-b21893a4283c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.568120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.568710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.568989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.569399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.569870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.571568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.577256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 794/1584] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.577940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.581526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 791/1585] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.582353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.588367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46db73-740d-4b93-8a00-b52f249bb21a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.594020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.594667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.594777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbead-5834-4d5c-adfe-dc19ba812ba4 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.594941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.595217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.595889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.597478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.599757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.600403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.600683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.600964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.601619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.604094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.609117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 795/1586] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.610031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.620170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6379cb-72cc-45f7-8b45-f9ba5f63ff5d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.624729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.625367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.625648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.625924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] PATH_INFO: `/v3/projects/71df24eaf2a242fa8e1cb24ec756f11a/users/86312e5441df4cf89028fbe807bef5b5/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.640563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71df24eaf2a242fa8e1cb24ec756f11a, user_id=86312e5441df4cf89028fbe807bef5b5, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.641525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:49:19.641525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:49:19.641525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:49:19.643475 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.690582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 792/1587] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:19.691583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.701050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74004195-2cd9-4f8e-b139-e187195c516a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.705635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.706325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.706893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.707375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.708406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.710062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.715128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 796/1588] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:19 2022] PUT /identity/v3/projects/71df24eaf2a242fa8e1cb24ec756f11a/users/86312e5441df4cf89028fbe807bef5b5/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:19.716099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.722434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 793/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.723313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.733367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc205802-278c-46c1-a2ef-c2e4f7c0a057 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.748369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:19.786659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91823-4f3b-4edd-8534-a2866d85b1c7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.791490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.791676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.792099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.792278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.792392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.792557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.792654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.792896 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.793317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.793584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.795029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.796331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.807594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 794/1590] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.809255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.813094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 797/1591] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.813094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.819816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3680bf8-9700-4dc7-b670-5b7878a33a51 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.821499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbffe3-c209-4a6a-88cb-a85f0cd08fb7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.825195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.825861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.826237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.826576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.827063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.827215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.827385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.827517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.827787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] PATH_INFO: `/v3/projects/07be0becb2794ba89b0c193a0099b626/users/e84efa1205e44747b5a133bcb788a675/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.828995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.841924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 795/1592] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.841924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.847243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07be0becb2794ba89b0c193a0099b626, user_id=e84efa1205e44747b5a133bcb788a675, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.849511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e593c-2a1b-43eb-bfdb-54ccf8c54e6f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.850196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.854194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.854788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.855067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.855339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.856012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.857563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.868331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 796/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.870438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.879725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913baf-21eb-448c-9752-f2a94294a1a0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:19.884954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa214-616f-48ff-8a7a-ae2af8605839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:19.885536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa214-616f-48ff-8a7a-ae2af8605839 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.885817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa214-616f-48ff-8a7a-ae2af8605839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.886089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa214-616f-48ff-8a7a-ae2af8605839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.886712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aa214-616f-48ff-8a7a-ae2af8605839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:19.888287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aa214-616f-48ff-8a7a-ae2af8605839 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:19.898035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 797/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:19.899181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fac9-cf7a-456b-89d6-e104d465b1e5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:19.899487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fac9-cf7a-456b-89d6-e104d465b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:19.899764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fac9-cf7a-456b-89d6-e104d465b1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:19.918527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-fbf2fac9-cf7a-456b-89d6-e104d465b1e5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:19.920032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fbf2fac9-cf7a-456b-89d6-e104d465b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:19.932404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 798/1595] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:19.933200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fac9-cf7a-456b-89d6-e104d465b1e5 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.933650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 798/1596] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:19 2022] PUT /identity/v3/projects/07be0becb2794ba89b0c193a0099b626/users/e84efa1205e44747b5a133bcb788a675/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:19.934542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:19.942860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fac9-cf7a-456b-89d6-e104d465b1e5 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.002342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.003012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.003302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.003615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] PATH_INFO: `/v3/projects/228bfc8aab3f49d2ab2c2a687674410f/users/0150a12ff77b433496b370fa47f0dbe7/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.005880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6cb0f-1b92-4870-be84-8372e3a67fc4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.010901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.011593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.011875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.012147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] PATH_INFO: `/v3/projects/7829ef7dedd84a0f92706a889d6aa214/users/4caa544507974140ba93bd63b1af484e/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.018095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228bfc8aab3f49d2ab2c2a687674410f, user_id=0150a12ff77b433496b370fa47f0dbe7, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.020785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.027047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7829ef7dedd84a0f92706a889d6aa214, user_id=4caa544507974140ba93bd63b1af484e, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.029731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.080084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:20.085592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 799/1597] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:19 2022] PUT /identity/v3/projects/228bfc8aab3f49d2ab2c2a687674410f/users/0150a12ff77b433496b370fa47f0dbe7/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:20.086446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.109142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 799/1598] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:19 2022] PUT /identity/v3/projects/7829ef7dedd84a0f92706a889d6aa214/users/4caa544507974140ba93bd63b1af484e/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:20.110019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.148807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1600bdb-3b1c-4832-81ff-f77e310b77c3 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.172810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a928-af5e-4174-b3e8-4d5a64bf945d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.177569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.178171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.178555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.178865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.179607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.181934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.192447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 800/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:20.193577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.203225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792588-77f2-4ce1-9e4e-1fd5fe537b6e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.205057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.205727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.206010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.206280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] PATH_INFO: `/v3/projects/4021c1633f434581b34a1357c8e63624/users/ef12fbaea8c14f548429b3733840ceeb/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.207763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6699d0-5fc0-41a0-a8ca-b2fb48c2bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.208378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6699d0-5fc0-41a0-a8ca-b2fb48c2bf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.208656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6699d0-5fc0-41a0-a8ca-b2fb48c2bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.208925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6699d0-5fc0-41a0-a8ca-b2fb48c2bf02 admin admin] PATH_INFO: `/v3/projects/ae16959df7324632a105f8284f095311/users/a2b1f29c3a20499ea9ecbbd9dfcbd231/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.220635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:20.220847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4021c1633f434581b34a1357c8e63624, user_id=ef12fbaea8c14f548429b3733840ceeb, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.223510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.223664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6699d0-5fc0-41a0-a8ca-b2fb48c2bf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae16959df7324632a105f8284f095311, user_id=a2b1f29c3a20499ea9ecbbd9dfcbd231, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.226465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6699d0-5fc0-41a0-a8ca-b2fb48c2bf02 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.297610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 800/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:20 2022] PUT /identity/v3/projects/4021c1633f434581b34a1357c8e63624/users/ef12fbaea8c14f548429b3733840ceeb/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:20.298461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.309392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 801/1601] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:20 2022] PUT /identity/v3/projects/ae16959df7324632a105f8284f095311/users/a2b1f29c3a20499ea9ecbbd9dfcbd231/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:20.310696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7fc6-e8bf-4e08-9c82-9f664f1d5344 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.310974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7fc6-e8bf-4e08-9c82-9f664f1d5344 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.311252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7fc6-e8bf-4e08-9c82-9f664f1d5344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.339207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-902e7fc6-e8bf-4e08-9c82-9f664f1d5344 None None] MFA Rules not processed for user `e84efa1205e44747b5a133bcb788a675`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:20.340445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-902e7fc6-e8bf-4e08-9c82-9f664f1d5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:20.359996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46660feb-61cb-4119-90c0-346a34d86b56 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.391668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:20.405829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 802/1602] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:20.406618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7fc6-e8bf-4e08-9c82-9f664f1d5344 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.418690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe23b3a-3abb-4920-8e39-8f7179c732a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.419310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23b3a-3abb-4920-8e39-8f7179c732a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.419615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23b3a-3abb-4920-8e39-8f7179c732a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.419890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23b3a-3abb-4920-8e39-8f7179c732a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.420655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe23b3a-3abb-4920-8e39-8f7179c732a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.422716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe23b3a-3abb-4920-8e39-8f7179c732a4 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.437056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 801/1603] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:20.438473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37476c0-8c08-49af-8262-cb8b742f3829 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.440474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37476c0-8c08-49af-8262-cb8b742f3829 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.440474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37476c0-8c08-49af-8262-cb8b742f3829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.458992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-e37476c0-8c08-49af-8262-cb8b742f3829 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:20.460223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e37476c0-8c08-49af-8262-cb8b742f3829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:20.465489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7fc6-e8bf-4e08-9c82-9f664f1d5344 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.468813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 802/1604] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:20.470455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003700d-4d20-4cd9-8755-bf8d69e4e755 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.470742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003700d-4d20-4cd9-8755-bf8d69e4e755 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.471011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003700d-4d20-4cd9-8755-bf8d69e4e755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.472175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.472909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.473203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.473479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.484304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.486215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.495493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 803/1605] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:20.496271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.503037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0003700d-4d20-4cd9-8755-bf8d69e4e755 None None] MFA Rules not processed for user `4caa544507974140ba93bd63b1af484e`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:20.504263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0003700d-4d20-4cd9-8755-bf8d69e4e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:20.505381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077ef08-fa17-468e-ab89-e89e0c316d76 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.511091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ace95-c168-4189-8faa-18c6004d95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.515651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ace95-c168-4189-8faa-18c6004d95ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.515651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ace95-c168-4189-8faa-18c6004d95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.515651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ace95-c168-4189-8faa-18c6004d95ff admin admin] PATH_INFO: `/v3/projects/8a6321d00ea84aecad02f43bf750bb98/users/4ffa5af31519487f9d769d33eb8b9278/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.528619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ace95-c168-4189-8faa-18c6004d95ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6321d00ea84aecad02f43bf750bb98, user_id=4ffa5af31519487f9d769d33eb8b9278, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.531285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ace95-c168-4189-8faa-18c6004d95ff admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.572391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 803/1606] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:20.573636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd1be-d1c1-448a-9986-da9e8a1a0c96 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.573920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd1be-d1c1-448a-9986-da9e8a1a0c96 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.574194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd1be-d1c1-448a-9986-da9e8a1a0c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.593137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7f3cd1be-d1c1-448a-9986-da9e8a1a0c96 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:20.595750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7f3cd1be-d1c1-448a-9986-da9e8a1a0c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:20.603070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 804/1607] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:20.604529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be624c1c-6fb4-4c91-a477-098dee89b559 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.604810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be624c1c-6fb4-4c91-a477-098dee89b559 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.605081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be624c1c-6fb4-4c91-a477-098dee89b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.623987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 804/1608] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:20 2022] PUT /identity/v3/projects/8a6321d00ea84aecad02f43bf750bb98/users/4ffa5af31519487f9d769d33eb8b9278/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:20.625544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ad76-8814-4148-a77e-73dab3768f75 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.625839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ad76-8814-4148-a77e-73dab3768f75 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.626116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ad76-8814-4148-a77e-73dab3768f75 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.626223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-be624c1c-6fb4-4c91-a477-098dee89b559 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:20.627493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 805/1609] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 28 08:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:20.627625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-be624c1c-6fb4-4c91-a477-098dee89b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:20.633550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480ad76-8814-4148-a77e-73dab3768f75 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.693866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 805/1610] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:20.694850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be624c1c-6fb4-4c91-a477-098dee89b559 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.709444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480ad76-8814-4148-a77e-73dab3768f75 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.715014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.715334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.715647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.716232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] PATH_INFO: `/v3/projects/25dbbda9c9fc46789bd6b1c846cbae9c/users/11d684f8b3cb4cbf9cf0675f9dcbc973/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.718589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:20.731706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25dbbda9c9fc46789bd6b1c846cbae9c, user_id=11d684f8b3cb4cbf9cf0675f9dcbc973, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.734403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.748409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:20.751999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be624c1c-6fb4-4c91-a477-098dee89b559 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.755609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.756211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.756490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.756756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.766312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.770776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.778444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 806/1611] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:20.779284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.788300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187a48-b0c2-4dd0-a077-35db2d934eb0 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.793031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8bae9-e589-4735-9517-479c6d55a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.799384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8bae9-e589-4735-9517-479c6d55a4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.799384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8bae9-e589-4735-9517-479c6d55a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.799384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8bae9-e589-4735-9517-479c6d55a4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.799384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8bae9-e589-4735-9517-479c6d55a4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.799384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8bae9-e589-4735-9517-479c6d55a4a5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.828702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 806/1612] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:20 2022] PUT /identity/v3/projects/25dbbda9c9fc46789bd6b1c846cbae9c/users/11d684f8b3cb4cbf9cf0675f9dcbc973/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:20.830967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:20.842422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:20.905697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e7083-3bd7-46f0-a2ff-0d8ee30f9011 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:20.909455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb614a1-f6ec-4d2c-8c4f-5c53e1965bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:20.910061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb614a1-f6ec-4d2c-8c4f-5c53e1965bdc service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.910334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb614a1-f6ec-4d2c-8c4f-5c53e1965bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.910631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb614a1-f6ec-4d2c-8c4f-5c53e1965bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.932980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 807/1613] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:20.937200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c14e-b34b-431e-a41d-5e14b8c20c14 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.937200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c14e-b34b-431e-a41d-5e14b8c20c14 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.937200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0c14e-b34b-431e-a41d-5e14b8c20c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:20.979866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb614a1-f6ec-4d2c-8c4f-5c53e1965bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:20.981519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb614a1-f6ec-4d2c-8c4f-5c53e1965bdc service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:20.982643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-97b0c14e-b34b-431e-a41d-5e14b8c20c14 None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:20.983622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-97b0c14e-b34b-431e-a41d-5e14b8c20c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:20.992127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 807/1614] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:20.994430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ba60b-7e1e-4ead-b284-cdb2aadb6b1e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:20.994716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ba60b-7e1e-4ead-b284-cdb2aadb6b1e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:20.994989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ba60b-7e1e-4ead-b284-cdb2aadb6b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.032064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a52ba60b-7e1e-4ead-b284-cdb2aadb6b1e None None] MFA Rules not processed for user `4ffa5af31519487f9d769d33eb8b9278`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:21.033218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a52ba60b-7e1e-4ead-b284-cdb2aadb6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:21.069080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 808/1615] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:21.070018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0c14e-b34b-431e-a41d-5e14b8c20c14 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.119560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 808/1616] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:21.125863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837124-1e0f-4d6f-9f80-293ac64bc0f1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.126471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837124-1e0f-4d6f-9f80-293ac64bc0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.126471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837124-1e0f-4d6f-9f80-293ac64bc0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.166721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e3837124-1e0f-4d6f-9f80-293ac64bc0f1 None None] MFA Rules not processed for user `11d684f8b3cb4cbf9cf0675f9dcbc973`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:21.169150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e3837124-1e0f-4d6f-9f80-293ac64bc0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:21.171909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0c14e-b34b-431e-a41d-5e14b8c20c14 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.181018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:21.181854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.189833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.191916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.192505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.255467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 809/1617] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:21.256416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837124-1e0f-4d6f-9f80-293ac64bc0f1 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.287222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.288853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.293797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:21.301988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 809/1618] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:21.307062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.316216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7fb13-1a0d-40a6-9ac3-3dd373e1decb service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.322758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d70d56-616b-49a1-830f-ced107626256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.324080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d70d56-616b-49a1-830f-ced107626256 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.324080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d70d56-616b-49a1-830f-ced107626256 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.335968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d70d56-616b-49a1-830f-ced107626256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.337357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837124-1e0f-4d6f-9f80-293ac64bc0f1 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.345525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91b6dd-e577-4cc3-9e23-83bb5bb71f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.346377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91b6dd-e577-4cc3-9e23-83bb5bb71f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.347371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91b6dd-e577-4cc3-9e23-83bb5bb71f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.348660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91b6dd-e577-4cc3-9e23-83bb5bb71f90 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.349135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91b6dd-e577-4cc3-9e23-83bb5bb71f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.354960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91b6dd-e577-4cc3-9e23-83bb5bb71f90 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.423402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d70d56-616b-49a1-830f-ced107626256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.425117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d70d56-616b-49a1-830f-ced107626256 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.435972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 810/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:21.437566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4cba-4562-4e8c-9c8d-6761080dfb7c None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.437954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4cba-4562-4e8c-9c8d-6761080dfb7c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.438719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4cba-4562-4e8c-9c8d-6761080dfb7c None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.444971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 811/1620] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 28 08:49:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:21.446661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4cba-4562-4e8c-9c8d-6761080dfb7c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.464436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4cba-4562-4e8c-9c8d-6761080dfb7c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.467334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 810/1621] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:21 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:21.468827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88563a17-0dcf-40e1-b5d2-39830e4b95dd None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.469624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88563a17-0dcf-40e1-b5d2-39830e4b95dd None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.469871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88563a17-0dcf-40e1-b5d2-39830e4b95dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.474672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.476008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.477513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.482944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.482944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.482944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.498360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-88563a17-0dcf-40e1-b5d2-39830e4b95dd None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:21.499970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-88563a17-0dcf-40e1-b5d2-39830e4b95dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:21.515765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 811/1622] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 28 08:49:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:21.516696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88563a17-0dcf-40e1-b5d2-39830e4b95dd None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.529331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88563a17-0dcf-40e1-b5d2-39830e4b95dd None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.534975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.540369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.540369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.540369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.540369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.540369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.549493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 812/1623] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:21.550503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.565618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be24c-b9cf-4a44-883b-2111e40662df admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.572551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.573151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.573550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.573824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.582050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.583796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.594630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 813/1624] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:21.595144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.607158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d01754-a734-4b5e-9152-aa63bb7a987f service nova] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.613099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.613888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.614143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.615001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] PATH_INFO: `/v3/projects/3a5142964f664163aad57e36c8a045b7/users/b738cfee03314fc6896d5b064c87cdee/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.625716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 812/1625] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:21 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:21.631675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.665860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5142964f664163aad57e36c8a045b7, user_id=b738cfee03314fc6896d5b064c87cdee, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.668900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.777018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 814/1626] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:21 2022] PUT /identity/v3/projects/3a5142964f664163aad57e36c8a045b7/users/b738cfee03314fc6896d5b064c87cdee/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:21.777825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.804953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f222c-0856-469f-becc-e8c779f37769 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.871748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:21.894199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c686e9-dd80-4fc1-9160-8b027800e8ff admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.904742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c36f-7533-44ef-86f3-6264a1da5aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.905604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c36f-7533-44ef-86f3-6264a1da5aff admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.906441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c36f-7533-44ef-86f3-6264a1da5aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.906808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c36f-7533-44ef-86f3-6264a1da5aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.907970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c36f-7533-44ef-86f3-6264a1da5aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.915962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11079e9-c1eb-4e52-a574-a253568561bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.916745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11079e9-c1eb-4e52-a574-a253568561bf admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.917198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11079e9-c1eb-4e52-a574-a253568561bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.917478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11079e9-c1eb-4e52-a574-a253568561bf admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.918713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11079e9-c1eb-4e52-a574-a253568561bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.918845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c36f-7533-44ef-86f3-6264a1da5aff admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.920150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11079e9-c1eb-4e52-a574-a253568561bf admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.941001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 815/1627] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:21.942593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224293-b8e5-403c-a514-9823e6a4af85 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.943077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224293-b8e5-403c-a514-9823e6a4af85 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.943719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9224293-b8e5-403c-a514-9823e6a4af85 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.945508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 816/1628] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 28 08:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:21.946494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9224293-b8e5-403c-a514-9823e6a4af85 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:21.966697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9224293-b8e5-403c-a514-9823e6a4af85 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:21.971995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416d9b8-fd10-4ace-af5b-a982996410c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:21.972878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416d9b8-fd10-4ace-af5b-a982996410c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.973356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416d9b8-fd10-4ace-af5b-a982996410c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.973823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416d9b8-fd10-4ace-af5b-a982996410c9 admin admin] PATH_INFO: `/v3/projects/3a5142964f664163aad57e36c8a045b7/users/b738cfee03314fc6896d5b064c87cdee/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:21.977583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416d9b8-fd10-4ace-af5b-a982996410c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5142964f664163aad57e36c8a045b7, user_id=b738cfee03314fc6896d5b064c87cdee, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:21.981672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416d9b8-fd10-4ace-af5b-a982996410c9 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:21.994282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 817/1629] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:21 2022] PUT /identity/v3/projects/3a5142964f664163aad57e36c8a045b7/users/b738cfee03314fc6896d5b064c87cdee/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:21.996156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f28e6-9396-4803-8330-7c274eda994d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:21.996663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f28e6-9396-4803-8330-7c274eda994d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:21.997124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f28e6-9396-4803-8330-7c274eda994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.016839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 813/1630] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:21 2022] POST /identity/v3/users => generated 293 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:22.019984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852dca-59a0-4023-8bf9-2d1a7bb2f11a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.020540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852dca-59a0-4023-8bf9-2d1a7bb2f11a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.021006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51852dca-59a0-4023-8bf9-2d1a7bb2f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.046488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-bf3f28e6-9396-4803-8330-7c274eda994d None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:22.046655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:22.047010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-bf3f28e6-9396-4803-8330-7c274eda994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:22.055061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-51852dca-59a0-4023-8bf9-2d1a7bb2f11a None None] MFA Rules not processed for user `b738cfee03314fc6896d5b064c87cdee`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:22.056743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-51852dca-59a0-4023-8bf9-2d1a7bb2f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:22.145655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 814/1631] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:22.146847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852dca-59a0-4023-8bf9-2d1a7bb2f11a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:22.200011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 818/1632] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:49:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:22.201380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96075-f7f1-4052-8c99-cc6aed91020f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.202792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96075-f7f1-4052-8c99-cc6aed91020f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.202792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e96075-f7f1-4052-8c99-cc6aed91020f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.215327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 819/1633] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 28 08:49:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:22.216535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e96075-f7f1-4052-8c99-cc6aed91020f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:22.245916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51852dca-59a0-4023-8bf9-2d1a7bb2f11a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:22.251731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:22.252525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.252811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.253086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.253904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:22.256585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:22.270479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 815/1634] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:22.277487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:22.317464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e96075-f7f1-4052-8c99-cc6aed91020f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:22.322512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca7c48-a7e4-4eda-b1ef-528ccbd8355b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:22.323549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7c48-a7e4-4eda-b1ef-528ccbd8355b service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.324057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7c48-a7e4-4eda-b1ef-528ccbd8355b service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.324336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7c48-a7e4-4eda-b1ef-528ccbd8355b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.335337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca7c48-a7e4-4eda-b1ef-528ccbd8355b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:22.340239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca7c48-a7e4-4eda-b1ef-528ccbd8355b service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:22.349533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 820/1635] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:22.350987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968d1a-f7af-4dac-bbae-4420e4062ffb None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.351281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968d1a-f7af-4dac-bbae-4420e4062ffb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.352693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968d1a-f7af-4dac-bbae-4420e4062ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.355280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f4e9b-fe7b-450e-bac8-4ef60b43e806 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:22.359346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:22.360188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.360535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.360818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.728037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:22.728037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:22.735337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b0968d1a-f7af-4dac-bbae-4420e4062ffb None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:22.735337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b0968d1a-f7af-4dac-bbae-4420e4062ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:22.737148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 816/1636] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:22.737148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:22.738941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 821/1637] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:22.740595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191edcbf-5545-403e-a6df-6e9671b780ab service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:22.740595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:22.740595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.740595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.741942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] PATH_INFO: `/v3/projects/247c5ccc46e64f15b1650b43838fcd76/users/4df5fe4ab8e844eb94f06803f38fecaa/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.741942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247c5ccc46e64f15b1650b43838fcd76, user_id=4df5fe4ab8e844eb94f06803f38fecaa, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:22.741942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:22.743087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968d1a-f7af-4dac-bbae-4420e4062ffb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:22.743087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968d1a-f7af-4dac-bbae-4420e4062ffb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:22.743087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:22.743087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.749909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.749909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.749909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:22.749909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:22.749909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 822/1638] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:49:22.750614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 817/1639] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:22 2022] PUT /identity/v3/projects/247c5ccc46e64f15b1650b43838fcd76/users/4df5fe4ab8e844eb94f06803f38fecaa/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:22.753076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:22.769436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f468d32-b05a-4666-a037-09943e3e27c5 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:22.862048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:22.881307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:22.881914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.882195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.890668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.890668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:22.890668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:22.911739 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:22.913361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 823/1640] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:22.932060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6889a6-d72b-4aaf-8346-137987f00688 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:22.938777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6322e1b-87f9-48e0-b43c-f6673ce0952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:22.939714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322e1b-87f9-48e0-b43c-f6673ce0952b admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:22.940071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322e1b-87f9-48e0-b43c-f6673ce0952b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:22.940621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6322e1b-87f9-48e0-b43c-f6673ce0952b admin admin] PATH_INFO: `/v3/projects/247c5ccc46e64f15b1650b43838fcd76/users/4df5fe4ab8e844eb94f06803f38fecaa/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:22.964821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6322e1b-87f9-48e0-b43c-f6673ce0952b admin admin] RBAC: Authorizing `identity:create_grant(project_id=247c5ccc46e64f15b1650b43838fcd76, user_id=4df5fe4ab8e844eb94f06803f38fecaa, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:22.975505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6322e1b-87f9-48e0-b43c-f6673ce0952b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:22.993028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:23.009659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:23.013084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 818/1641] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:22 2022] PUT /identity/v3/projects/247c5ccc46e64f15b1650b43838fcd76/users/4df5fe4ab8e844eb94f06803f38fecaa/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:23.029965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d53a-926a-4355-9cfe-c97e623c79b2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:23.030522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d53a-926a-4355-9cfe-c97e623c79b2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:23.030522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78d53a-926a-4355-9cfe-c97e623c79b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:23.037206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d8f9-8ba9-43e9-a73c-9f1e203d313f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:23.088520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2a78d53a-926a-4355-9cfe-c97e623c79b2 None None] MFA Rules not processed for user `4df5fe4ab8e844eb94f06803f38fecaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:23.091308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2a78d53a-926a-4355-9cfe-c97e623c79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:23.110955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:23.112018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:23.112283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:23.114758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] PATH_INFO: `/v3/users/e84efa1205e44747b5a133bcb788a675` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:23.116229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84efa1205e44747b5a133bcb788a675)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:23.117283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: WARNING py.warnings [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:49:23.117283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: warnings.warn(msg) Sep 28 08:49:23.117283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: Sep 28 08:49:23.119087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:23.275700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 819/1642] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:23.378044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78d53a-926a-4355-9cfe-c97e623c79b2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:23.440533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84efa1205e44747b5a133bcb788a675'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:23.441369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84efa1205e44747b5a133bcb788a675'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:23.468080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84efa1205e44747b5a133bcb788a675'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:23.469277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78d53a-926a-4355-9cfe-c97e623c79b2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:23.476195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf6f96-a2cc-4ac5-8f89-7e4ae446aa86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:23.477893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf6f96-a2cc-4ac5-8f89-7e4ae446aa86 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:23.478447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf6f96-a2cc-4ac5-8f89-7e4ae446aa86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:23.478577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf6f96-a2cc-4ac5-8f89-7e4ae446aa86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:23.480425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c6cf6f96-a2cc-4ac5-8f89-7e4ae446aa86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:23.497572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf6f96-a2cc-4ac5-8f89-7e4ae446aa86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:23.498839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf6f96-a2cc-4ac5-8f89-7e4ae446aa86 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:23.512780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 820/1643] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:49:23.565266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84efa1205e44747b5a133bcb788a675'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:23.565952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84efa1205e44747b5a133bcb788a675'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:23.583679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 824/1644] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:23 2022] DELETE /identity/v3/users/e84efa1205e44747b5a133bcb788a675 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:49:23.588591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:23.588805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:23.589153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:23.608760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:23.610491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:23.792791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 821/1645] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:23.842032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:23.843283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:23.913549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796808-269a-41c8-83eb-422e85579a2d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:23.932454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:23.933324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:23.933993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:23.934419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:23.959009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:23.967659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:23.982989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 825/1646] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:24.002270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:24.004488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:24.060419 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:24.124613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbeb5a8-b0cf-417f-8d9b-0d161a4e6235 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:24.131320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c51005-100c-4981-9eec-a5e8594961cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:24.131320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51005-100c-4981-9eec-a5e8594961cf service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:24.131320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51005-100c-4981-9eec-a5e8594961cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:24.131612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51005-100c-4981-9eec-a5e8594961cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:24.139272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c2c51005-100c-4981-9eec-a5e8594961cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:24.288047 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c51005-100c-4981-9eec-a5e8594961cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:24.292723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c51005-100c-4981-9eec-a5e8594961cf service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:24.333744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 822/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:24.559841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:24.561331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:24.569990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:24.576406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f761c7b-6fdf-4fa9-92c5-af6cb6c37220 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:24.583592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:24.584363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:24.584711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:24.585053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] PATH_INFO: `/v3/users/4caa544507974140ba93bd63b1af484e` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:24.590172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4caa544507974140ba93bd63b1af484e)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:24.590172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:24.842422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4caa544507974140ba93bd63b1af484e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:24.843071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4caa544507974140ba93bd63b1af484e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:24.868707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4caa544507974140ba93bd63b1af484e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:24.995395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4caa544507974140ba93bd63b1af484e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:24.996671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4caa544507974140ba93bd63b1af484e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:25.040583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 826/1648] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:24 2022] DELETE /identity/v3/users/4caa544507974140ba93bd63b1af484e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:25.043042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:25.043334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:25.043658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:25.081898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:25.084607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:25.213559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 823/1649] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:25.223493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:25.225215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:25.260084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:25.261697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:25.280622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204799f2-dc17-460d-8a83-9f22c8a83b3a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:25.295706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:25.296365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:25.296644 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:25.296919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] PATH_INFO: `/v3/projects/07be0becb2794ba89b0c193a0099b626` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:25.298259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=07be0becb2794ba89b0c193a0099b626)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:25.299290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: WARNING py.warnings [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 28 08:49:25.299290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: warnings.warn(msg) Sep 28 08:49:25.299290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: Sep 28 08:49:25.300524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:25.406233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9e416-4801-4702-917e-51ce430081c3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:25.416643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727a439-aefd-4fd9-bb4f-ee1da87e1e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:25.417474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727a439-aefd-4fd9-bb4f-ee1da87e1e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:25.417888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727a439-aefd-4fd9-bb4f-ee1da87e1e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:25.418294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727a439-aefd-4fd9-bb4f-ee1da87e1e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:25.454577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727a439-aefd-4fd9-bb4f-ee1da87e1e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:25.456081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727a439-aefd-4fd9-bb4f-ee1da87e1e0a service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:25.471408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 827/1650] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:25.563677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07be0becb2794ba89b0c193a0099b626', 'request_id': 'req-999c9031-974b-4feb-980e-04b90be6c5ce'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:25.596586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07be0becb2794ba89b0c193a0099b626', 'request_id': 'req-999c9031-974b-4feb-980e-04b90be6c5ce'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:25.685248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07be0becb2794ba89b0c193a0099b626', 'request_id': 'req-999c9031-974b-4feb-980e-04b90be6c5ce'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:25.703796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] The token cache is being invalidate because project 07be0becb2794ba89b0c193a0099b626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:25.704296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:25.710221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-999c9031-974b-4feb-980e-04b90be6c5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:25.714823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 824/1651] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:25 2022] DELETE /identity/v3/projects/07be0becb2794ba89b0c193a0099b626 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:25.719871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b751ea-d803-46e8-9e26-a15e57dcde59 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:25.720854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b751ea-d803-46e8-9e26-a15e57dcde59 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:25.721128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b751ea-d803-46e8-9e26-a15e57dcde59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:25.760199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-89b751ea-d803-46e8-9e26-a15e57dcde59 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:25.762668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-89b751ea-d803-46e8-9e26-a15e57dcde59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:25.858422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 828/1652] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:25.867171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea616-0907-4fb8-8817-ce10e3afa72a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:25.868893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea616-0907-4fb8-8817-ce10e3afa72a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:25.869299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea616-0907-4fb8-8817-ce10e3afa72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:25.885738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:25.901912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b87ea616-0907-4fb8-8817-ce10e3afa72a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:25.905073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b87ea616-0907-4fb8-8817-ce10e3afa72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:25.917924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 825/1653] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:25.922112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b751ea-d803-46e8-9e26-a15e57dcde59 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:25.938133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b751ea-d803-46e8-9e26-a15e57dcde59 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:25.943794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:25.944567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:25.944913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:25.945290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:25.946445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:25.946856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:25.949223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:25.964928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 829/1654] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:49:25.969380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea616-0907-4fb8-8817-ce10e3afa72a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:25.991651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea616-0907-4fb8-8817-ce10e3afa72a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:26.001428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:26.002548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:26.002840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:26.003594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:26.004441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:26.006555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:26.126916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 826/1655] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:25 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:26.131395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:26.153096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5735b1-1b2b-4046-bfe9-25f6de24f8b5 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:26.272377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:26.273147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:26.274094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:26.275205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:26.275959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:26.279127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:26.397822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 830/1656] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:26 2022] POST /identity/v3/users => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:26.404006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:26.426947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7aa59-4137-44d3-a315-15bef336f859 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:26.441742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:26.442534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:26.442909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:26.443277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:26.444445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:26.448482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:26.478020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 827/1657] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:26.490826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:26.508552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b65fa-32f1-4e32-b276-4b74c7c0cd1a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:26.513742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:26.520854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350df10-f628-45b6-ad60-1cd6cd9af2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:26.521474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350df10-f628-45b6-ad60-1cd6cd9af2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:26.521756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350df10-f628-45b6-ad60-1cd6cd9af2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:26.522033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350df10-f628-45b6-ad60-1cd6cd9af2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:26.524576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350df10-f628-45b6-ad60-1cd6cd9af2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:26.528817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350df10-f628-45b6-ad60-1cd6cd9af2e9 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:26.564456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 831/1658] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:26.568626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:26.589190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b6f24-fe70-4ad4-8302-57b783326dce admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:26.604965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:26.605660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:26.614774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:26.614774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] PATH_INFO: `/v3/projects/c9873f77e0674315b4a6fccb7b43cfb0/users/4aa1bac7a7ce4430a5b1e5b6d948cf87/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:26.649880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9873f77e0674315b4a6fccb7b43cfb0, user_id=4aa1bac7a7ce4430a5b1e5b6d948cf87, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:26.655309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:26.750183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 828/1659] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:26 2022] PUT /identity/v3/projects/c9873f77e0674315b4a6fccb7b43cfb0/users/4aa1bac7a7ce4430a5b1e5b6d948cf87/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:26.756652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:26.756652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:26.756900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:26.792957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:26.795657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:26.852999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:26.854784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:27.039336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 832/1660] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:27.104423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:27.105159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:27.112536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63831e-c8c3-4137-b811-8e32cc4a5d16 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:27.132206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:27.133493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:27.133929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:27.134715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] PATH_INFO: `/v3/projects/7829ef7dedd84a0f92706a889d6aa214` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:27.141049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7829ef7dedd84a0f92706a889d6aa214)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:27.142972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:27.328772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d7a84-c460-4b96-b919-63cd7f62c022 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:27.347308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:27.349081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:27.349368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:27.349638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:27.379068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:27.380170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7829ef7dedd84a0f92706a889d6aa214', 'request_id': 'req-10b50e51-a4c0-4d89-a45e-27818c60912b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:27.382403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:27.408195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7829ef7dedd84a0f92706a889d6aa214', 'request_id': 'req-10b50e51-a4c0-4d89-a45e-27818c60912b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:27.420033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 833/1661] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:27.421643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:27.424322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:27.456138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef5ca6-2cd5-4670-b57d-268f9024f808 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:27.520127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7829ef7dedd84a0f92706a889d6aa214', 'request_id': 'req-10b50e51-a4c0-4d89-a45e-27818c60912b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:27.541612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] The token cache is being invalidate because project 7829ef7dedd84a0f92706a889d6aa214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:27.542290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:27.545862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:27.551917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 829/1662] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:26 2022] DELETE /identity/v3/projects/7829ef7dedd84a0f92706a889d6aa214 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:27.560627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:27.566920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:27.614127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:27.614824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:27.615079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:27.615360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] PATH_INFO: `/v3/users/4ffa5af31519487f9d769d33eb8b9278` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:27.618870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffa5af31519487f9d769d33eb8b9278)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:27.641220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:27.768845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b50e51-a4c0-4d89-a45e-27818c60912b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:27.776328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:27.777270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:27.777721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:27.778375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] PATH_INFO: `/v3/users/b738cfee03314fc6896d5b064c87cdee` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:27.779759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b738cfee03314fc6896d5b064c87cdee)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:27.782469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:27.788184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:27.955117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffa5af31519487f9d769d33eb8b9278'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:27.956248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffa5af31519487f9d769d33eb8b9278'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.006593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffa5af31519487f9d769d33eb8b9278'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.027984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:28.120240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffa5af31519487f9d769d33eb8b9278'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.121126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ee6296d7-94ea-415d-afee-ee5c61aeb060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffa5af31519487f9d769d33eb8b9278'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.130518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b738cfee03314fc6896d5b064c87cdee'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.136324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b738cfee03314fc6896d5b064c87cdee'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.156659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 834/1663] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:27 2022] DELETE /identity/v3/users/4ffa5af31519487f9d769d33eb8b9278 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:28.167187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:28.169451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:28.171593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:28.235198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b738cfee03314fc6896d5b064c87cdee'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.288861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:28.295315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:28.353721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b738cfee03314fc6896d5b064c87cdee'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.354585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b738cfee03314fc6896d5b064c87cdee'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:28.386632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 830/1664] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:27 2022] DELETE /identity/v3/users/b738cfee03314fc6896d5b064c87cdee => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:49:28.509376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 835/1665] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:28.572844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:28.574333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:28.713518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c7f7-3332-4943-a29b-5c22924821ea admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:28.721284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fac26-c36e-44b8-a3e8-f030963d0024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:28.721925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fac26-c36e-44b8-a3e8-f030963d0024 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:28.722231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fac26-c36e-44b8-a3e8-f030963d0024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:28.722481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fac26-c36e-44b8-a3e8-f030963d0024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:28.843448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fac26-c36e-44b8-a3e8-f030963d0024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:28.847155 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fac26-c36e-44b8-a3e8-f030963d0024 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:28.874454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 831/1666] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:29.593060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:30.337870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:30.340433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:30.363596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b03da5-bc3c-4af1-b7e3-3ed054c17912 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:30.380694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:30.381777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:30.382229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:30.386014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] PATH_INFO: `/v3/projects/3a5142964f664163aad57e36c8a045b7` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:30.389214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5142964f664163aad57e36c8a045b7)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:30.395581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:30.582530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:30.599034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5142964f664163aad57e36c8a045b7', 'request_id': 'req-d122ceef-4de9-444f-94b8-92dd780de93e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:30.609491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5142964f664163aad57e36c8a045b7', 'request_id': 'req-d122ceef-4de9-444f-94b8-92dd780de93e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:30.692071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5142964f664163aad57e36c8a045b7', 'request_id': 'req-d122ceef-4de9-444f-94b8-92dd780de93e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:30.710152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] The token cache is being invalidate because project 3a5142964f664163aad57e36c8a045b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:30.711841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:30.714528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d122ceef-4de9-444f-94b8-92dd780de93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:30.717051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 836/1667] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:30 2022] DELETE /identity/v3/projects/3a5142964f664163aad57e36c8a045b7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:30.721600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35da96-9e48-47c6-bb65-d0c87dbfeaea None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:30.722042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35da96-9e48-47c6-bb65-d0c87dbfeaea None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:30.722300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35da96-9e48-47c6-bb65-d0c87dbfeaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:30.770691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0f35da96-9e48-47c6-bb65-d0c87dbfeaea None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:30.774994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0f35da96-9e48-47c6-bb65-d0c87dbfeaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:30.994839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 832/1668] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:31.004589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fd98f-b552-4158-b246-1249d4d0b1ba None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.005251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fd98f-b552-4158-b246-1249d4d0b1ba None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.005723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fd98f-b552-4158-b246-1249d4d0b1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.065649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1a1fd98f-b552-4158-b246-1249d4d0b1ba None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:31.068269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1a1fd98f-b552-4158-b246-1249d4d0b1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:31.097919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 837/1669] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:31.102847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35da96-9e48-47c6-bb65-d0c87dbfeaea None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:31.113883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35da96-9e48-47c6-bb65-d0c87dbfeaea None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:31.125338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:31.125776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.126472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.126472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.127242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:31.127592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:31.129426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:31.155912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 833/1670] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:31.162204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fd98f-b552-4158-b246-1249d4d0b1ba None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:31.176216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fd98f-b552-4158-b246-1249d4d0b1ba None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:31.186448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:31.186448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.186448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.186775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.187322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:31.189329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:31.364372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 838/1671] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:31 2022] POST /identity/v3/projects => generated 369 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:31.369431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:31.387652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6bf32-ffa0-4dbd-88b9-d26ce70be594 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:31.510386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:31.511026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.511310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.511612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.514456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:31.517205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:31.654568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 834/1672] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:31 2022] POST /identity/v3/users => generated 285 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:31.658564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:31.677396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077507b-15dd-48d6-ae32-c80166e6fac1 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:31.684656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:31.685774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.686256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.686762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.689011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:31.691376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:31.709029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 839/1673] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:31.710302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:31.735091 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b81e9-f7f2-4783-a4a1-d30513668caa admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:31.741623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:31.743460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.743953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.744440 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.745329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:31.747245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:31.766408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 835/1674] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:31.766733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:31.792287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5218f-6557-4264-8e5c-2743754adefb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:31.803647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e89cb-f66e-4b96-a7c0-35fdf73650cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:31.805649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e89cb-f66e-4b96-a7c0-35fdf73650cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.808694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e89cb-f66e-4b96-a7c0-35fdf73650cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.809501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e89cb-f66e-4b96-a7c0-35fdf73650cc admin admin] PATH_INFO: `/v3/projects/ce23ce46606a400c9cb6deeaae810d62/users/c71a4e06024e4a33af9e1675545c8511/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.840786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:31.843565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:31.849159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e89cb-f66e-4b96-a7c0-35fdf73650cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce23ce46606a400c9cb6deeaae810d62, user_id=c71a4e06024e4a33af9e1675545c8511, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:31.857442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e89cb-f66e-4b96-a7c0-35fdf73650cc admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:31.870987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a363-84c8-4a89-a2dd-4c83d2960c7e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:31.886407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:31.887495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.888273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.889093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] PATH_INFO: `/v3/projects/8a6321d00ea84aecad02f43bf750bb98` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:31.892737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6321d00ea84aecad02f43bf750bb98)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:31.895113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:31.938498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 840/1675] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:31 2022] PUT /identity/v3/projects/ce23ce46606a400c9cb6deeaae810d62/users/c71a4e06024e4a33af9e1675545c8511/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:49:31.948980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813622d7-373a-405a-9acc-21d4cc506226 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:31.949268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813622d7-373a-405a-9acc-21d4cc506226 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:31.949545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813622d7-373a-405a-9acc-21d4cc506226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:32.015969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-813622d7-373a-405a-9acc-21d4cc506226 None None] MFA Rules not processed for user `c71a4e06024e4a33af9e1675545c8511`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:32.017385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-813622d7-373a-405a-9acc-21d4cc506226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:32.081360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6321d00ea84aecad02f43bf750bb98', 'request_id': 'req-964ab81f-d427-4007-ac1b-2b9cd06977b3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:32.107319 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6321d00ea84aecad02f43bf750bb98', 'request_id': 'req-964ab81f-d427-4007-ac1b-2b9cd06977b3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:32.178983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 841/1676] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:32.184634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f7ce9-ffe5-4691-8049-002ecec147a9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:32.185675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f7ce9-ffe5-4691-8049-002ecec147a9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:32.186238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f7ce9-ffe5-4691-8049-002ecec147a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:32.239618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6321d00ea84aecad02f43bf750bb98', 'request_id': 'req-964ab81f-d427-4007-ac1b-2b9cd06977b3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:32.241179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:32.249014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-773f7ce9-ffe5-4691-8049-002ecec147a9 None None] MFA Rules not processed for user `4aa1bac7a7ce4430a5b1e5b6d948cf87`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:32.251229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-773f7ce9-ffe5-4691-8049-002ecec147a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:32.260648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] The token cache is being invalidate because project 8a6321d00ea84aecad02f43bf750bb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:32.260945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:32.262080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:32.264767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 836/1677] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:31 2022] DELETE /identity/v3/projects/8a6321d00ea84aecad02f43bf750bb98 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:32.265615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:32.272488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:32.409758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 842/1678] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:32.411771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:32.412227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:32.412633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:32.417062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab81f-d427-4007-ac1b-2b9cd06977b3 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:32.422929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39d12-e579-482e-abaa-dffc22404909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:32.423567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39d12-e579-482e-abaa-dffc22404909 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:32.423904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39d12-e579-482e-abaa-dffc22404909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:32.424183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39d12-e579-482e-abaa-dffc22404909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:32.425181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c39d12-e579-482e-abaa-dffc22404909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:32.427211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c39d12-e579-482e-abaa-dffc22404909 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:32.489333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:32.493477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:32.511866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 843/1679] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:32.513616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:32.517190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:32.542570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56255a32-aa79-4c5d-a8f0-145496600a4b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:32.556025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:32.556783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:32.556986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:32.557261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:32.557912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:32.559890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:32.579323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 837/1680] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:32 2022] POST /identity/v3/projects => generated 367 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:32.580808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db22366-216f-4838-b422-fbe6bd393b16 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:32.581889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db22366-216f-4838-b422-fbe6bd393b16 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:32.582179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db22366-216f-4838-b422-fbe6bd393b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:32.645349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0db22366-216f-4838-b422-fbe6bd393b16 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:32.652152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0db22366-216f-4838-b422-fbe6bd393b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:32.693891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 844/1681] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:32 2022] POST /identity/v3/projects => generated 405 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:32.694880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:32.771737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:32.815531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 838/1682] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:32.817901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db22366-216f-4838-b422-fbe6bd393b16 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:32.836995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db22366-216f-4838-b422-fbe6bd393b16 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:32.907856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37698a3c-fb0b-448f-ab3a-dbc84451f68e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:32.923788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:32.927583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:32.927583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:32.927583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:32.930980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:32.935455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.025435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.026620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.027397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.027834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.030384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.034294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.040575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 845/1683] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:32 2022] POST /identity/v3/users => generated 290 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:33.041647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.095483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1bcce-fcd6-426b-ba12-cfe04d48df89 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.113875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.114576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.114861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.115136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.120214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:33.120519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.122164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.126722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 839/1684] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:32 2022] POST /identity/v3/users => generated 309 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:33.129141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.147575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae99ae0-98c9-4afb-b1b4-b799f3fa7b69 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.157929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 846/1685] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:33.162173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.165925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.166593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.166876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.167147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.167873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.169470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.180098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbbab7-f3fe-4901-b3be-f6ef176bd64c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.193968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 840/1686] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:33.194849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.197631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.198327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.198782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.198908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.199580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.201369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.215799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4e5aa-f360-44f2-93b9-7148516f22d9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.228204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.231015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.231015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.231015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.231015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.232010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.240531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 847/1687] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:33.241296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.262002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439314fc-0286-48a3-868d-57f7dcc7f6f5 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.268941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.270050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.270573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.271049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] PATH_INFO: `/v3/projects/c6824008c22540849e3c4efa2c2bde6a/users/cd43263adbd046fd95940236536b0086/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.295606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6824008c22540849e3c4efa2c2bde6a, user_id=cd43263adbd046fd95940236536b0086, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.299106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.400301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 841/1688] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:33 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:33.400301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.426511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 848/1689] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:33 2022] PUT /identity/v3/projects/c6824008c22540849e3c4efa2c2bde6a/users/cd43263adbd046fd95940236536b0086/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:33.427998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.578533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb29cf1-b0e4-47c7-8464-2b170e0526ad admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.634872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676da2f-9db9-459a-9367-00d486ae3c63 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.643197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.643967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.644308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.644689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.645413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.653115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.789981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 849/1690] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:33 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:33.791165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.812210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085da4f-3ac0-44a7-85dc-8e61ffc2ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.813895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085da4f-3ac0-44a7-85dc-8e61ffc2ac39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.819010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085da4f-3ac0-44a7-85dc-8e61ffc2ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.819010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085da4f-3ac0-44a7-85dc-8e61ffc2ac39 admin admin] PATH_INFO: `/v3/projects/f07fbdb580bd416fa2a009fa0c8e95fc/users/b856793f2f0a453eb9e7c89dfe5f91b8/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.823781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58340320-42a8-4f20-976c-13809bac78bf admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.844542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.845711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.846140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.846663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.847644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.852823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.877287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 850/1691] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:33.878388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.881386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085da4f-3ac0-44a7-85dc-8e61ffc2ac39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07fbdb580bd416fa2a009fa0c8e95fc, user_id=b856793f2f0a453eb9e7c89dfe5f91b8, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.895593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085da4f-3ac0-44a7-85dc-8e61ffc2ac39 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.902352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424813-36a4-41ca-8d3d-86e0b07887eb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.918240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.918950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.919356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:33.919694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:33.920509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:33.922511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:33.951449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 851/1692] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:33.953970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:33.982404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bacb5b-b48c-4990-81c3-9cbc8c9d858c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:33.998662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:33.999544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:33.999968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.000559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] PATH_INFO: `/v3/projects/c6824008c22540849e3c4efa2c2bde6a/users/cd43263adbd046fd95940236536b0086/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.004440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6824008c22540849e3c4efa2c2bde6a, user_id=cd43263adbd046fd95940236536b0086, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:34.007272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:34.037271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 852/1693] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:33 2022] PUT /identity/v3/projects/c6824008c22540849e3c4efa2c2bde6a/users/cd43263adbd046fd95940236536b0086/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:34.038299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:34.055168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 842/1694] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:33 2022] PUT /identity/v3/projects/f07fbdb580bd416fa2a009fa0c8e95fc/users/b856793f2f0a453eb9e7c89dfe5f91b8/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:34.059833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b09277-4ee6-426d-bb6e-8be18db5cd66 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:34.059833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b09277-4ee6-426d-bb6e-8be18db5cd66 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.059833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b09277-4ee6-426d-bb6e-8be18db5cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.155364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a0b09277-4ee6-426d-bb6e-8be18db5cd66 None None] MFA Rules not processed for user `cd43263adbd046fd95940236536b0086`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:34.160216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a0b09277-4ee6-426d-bb6e-8be18db5cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:34.176061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e309b-ef30-4820-aa90-88bb2b9993fc admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:34.326263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:34.326905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:34.327190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.327497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.328158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:34.330036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:34.354915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 853/1695] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:34.355942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:34.357335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 843/1696] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:34.359748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b09277-4ee6-426d-bb6e-8be18db5cd66 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:34.377976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039be27-3405-430e-ac29-ffa82a4813b4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:34.385491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b09277-4ee6-426d-bb6e-8be18db5cd66 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:34.392246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:34.392884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:34.393163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.393437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.394100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:34.395764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:34.404100 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:34.406451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:34.406694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.406968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] PATH_INFO: `/v3/projects/b9ac37a4082341a0896639547c4049a8/users/b12dc83834c844b88d27775a2e11155f/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.419585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 854/1697] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:34.420572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:34.433731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:34.449707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ac37a4082341a0896639547c4049a8, user_id=b12dc83834c844b88d27775a2e11155f, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:34.452477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:34.473677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:34.550118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c3054-04c4-48e5-9839-e5a2c0bccc7f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:34.562657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb823283-21b3-479e-a47b-0daa8814b616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:34.563542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb823283-21b3-479e-a47b-0daa8814b616 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:34.563968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb823283-21b3-479e-a47b-0daa8814b616 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.564380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb823283-21b3-479e-a47b-0daa8814b616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.584730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb823283-21b3-479e-a47b-0daa8814b616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:34.587107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb823283-21b3-479e-a47b-0daa8814b616 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:34.610369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 855/1698] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:34.611734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 844/1699] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:34 2022] PUT /identity/v3/projects/b9ac37a4082341a0896639547c4049a8/users/b12dc83834c844b88d27775a2e11155f/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:34.611734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:34.623054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d77b-6ad4-4444-b1de-177869e816fd None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:34.623969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d77b-6ad4-4444-b1de-177869e816fd None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.625015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d77b-6ad4-4444-b1de-177869e816fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.686571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9ef2d77b-6ad4-4444-b1de-177869e816fd None None] MFA Rules not processed for user `b12dc83834c844b88d27775a2e11155f`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:34.692360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9ef2d77b-6ad4-4444-b1de-177869e816fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:34.783586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f9572-902a-48a8-b1df-f2bed9a0b39d admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:34.811842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:34.815644 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:34.815644 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:34.815644 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] PATH_INFO: `/v3/projects/f07fbdb580bd416fa2a009fa0c8e95fc/users/b856793f2f0a453eb9e7c89dfe5f91b8/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:34.819252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07fbdb580bd416fa2a009fa0c8e95fc, user_id=b856793f2f0a453eb9e7c89dfe5f91b8, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:34.825129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:34.841052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 845/1700] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:34 2022] PUT /identity/v3/projects/f07fbdb580bd416fa2a009fa0c8e95fc/users/b856793f2f0a453eb9e7c89dfe5f91b8/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:34.842580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:34.855278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 856/1701] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:34.868728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d77b-6ad4-4444-b1de-177869e816fd None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:34.892059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d77b-6ad4-4444-b1de-177869e816fd None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:35.032387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:35.039733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.040805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.041106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.041778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:35.053236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:35.054226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b626b6-df30-42e5-a2b8-e159f83a532e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:35.072170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:35.077019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcd0ca-6433-4d28-ab45-0a971758cc95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:35.083257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd0ca-6433-4d28-ab45-0a971758cc95 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.083257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd0ca-6433-4d28-ab45-0a971758cc95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.083257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd0ca-6433-4d28-ab45-0a971758cc95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.083257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b9fcd0ca-6433-4d28-ab45-0a971758cc95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:35.169602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 857/1702] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:34 2022] POST /identity/v3/projects => generated 381 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:35.175177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:35.263310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcd0ca-6433-4d28-ab45-0a971758cc95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:35.265030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcd0ca-6433-4d28-ab45-0a971758cc95 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:35.305775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 846/1703] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:35.372211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae08d1-48de-4abe-a2e8-7a932fbadae4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:35.384795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:35.385538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.385684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.386056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.389363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:35.401539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:35.450386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37d18-532b-476b-b763-ca12ea6a0a79 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.451161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37d18-532b-476b-b763-ca12ea6a0a79 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.451711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37d18-532b-476b-b763-ca12ea6a0a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.527250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7af37d18-532b-476b-b763-ca12ea6a0a79 None None] MFA Rules not processed for user `86312e5441df4cf89028fbe807bef5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:35.528537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7af37d18-532b-476b-b763-ca12ea6a0a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:35.554839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 858/1704] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:35 2022] POST /identity/v3/users => generated 297 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:35.558681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:35.573831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970327c0-d76b-4d2e-b188-ba996e48ef7e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:35.587136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:35.589818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.590026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.590707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.591370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:35.595833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:35.622811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 859/1705] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:35.629092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:35.650199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fc02d-957d-4bfe-b81f-0ad844153c4d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:35.660956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:35.662775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.662775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.664940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] PATH_INFO: `/v3/projects/22e9da30f3c4483f83f0b481d2939e5c/users/90941df44bf8429da5a663bd4eb51e58/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.706120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 847/1706] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:35.706412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e9da30f3c4483f83f0b481d2939e5c, user_id=90941df44bf8429da5a663bd4eb51e58, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:35.706412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:35.706596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432a92-80a2-4f5b-abf5-d222f46284d8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.706596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432a92-80a2-4f5b-abf5-d222f46284d8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.706596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432a92-80a2-4f5b-abf5-d222f46284d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.746164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-19432a92-80a2-4f5b-abf5-d222f46284d8 None None] MFA Rules not processed for user `86312e5441df4cf89028fbe807bef5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:35.748115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-19432a92-80a2-4f5b-abf5-d222f46284d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:35.757003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 848/1707] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:35.759096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455b2f-7c96-4f46-ae10-5568dd74164c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:35.759976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455b2f-7c96-4f46-ae10-5568dd74164c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:35.760224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455b2f-7c96-4f46-ae10-5568dd74164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:35.800314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 860/1708] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:35 2022] PUT /identity/v3/projects/22e9da30f3c4483f83f0b481d2939e5c/users/90941df44bf8429da5a663bd4eb51e58/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:35.803042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:35.805516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:35.855381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-4f455b2f-7c96-4f46-ae10-5568dd74164c None None] MFA Rules not processed for user `ef12fbaea8c14f548429b3733840ceeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:35.869249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4f455b2f-7c96-4f46-ae10-5568dd74164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:36.013984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 849/1709] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:36.015456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f455b2f-7c96-4f46-ae10-5568dd74164c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:36.031844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80fa0a-44b6-4d2b-beb7-3b23dd4278c8 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:36.050399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:36.051022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:36.051306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:36.051608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:36.275283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f455b2f-7c96-4f46-ae10-5568dd74164c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:36.298689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:36.303117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:36.303483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:36.303787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:36.304720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:36.310295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:36.324003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:36.325634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:36.361608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 850/1710] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:36.364571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 861/1711] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:36.365525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:36.365726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:36.369901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:36.402603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6de1ef-6ef8-4b6c-9b25-e6f49dfdbb30 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:36.406397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f27db-f254-4abb-b7c8-25653699fed0 service nova] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:36.409245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab874475-892a-4a62-aa8b-77f84beaeff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:36.410262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab874475-892a-4a62-aa8b-77f84beaeff4 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:36.410549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab874475-892a-4a62-aa8b-77f84beaeff4 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:36.410832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab874475-892a-4a62-aa8b-77f84beaeff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:36.422393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab874475-892a-4a62-aa8b-77f84beaeff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:36.424435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab874475-892a-4a62-aa8b-77f84beaeff4 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:36.437939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:36.438849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:36.447668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:36.447787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 851/1712] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:36.447959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] PATH_INFO: `/v3/projects/22e9da30f3c4483f83f0b481d2939e5c/users/90941df44bf8429da5a663bd4eb51e58/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:36.454853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e9da30f3c4483f83f0b481d2939e5c, user_id=90941df44bf8429da5a663bd4eb51e58, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:36.457601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:36.519405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 862/1713] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:36 2022] PUT /identity/v3/projects/22e9da30f3c4483f83f0b481d2939e5c/users/90941df44bf8429da5a663bd4eb51e58/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:36.530393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f518cd-fa4e-4fc6-b5f7-d9714d18a868 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:36.530680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f518cd-fa4e-4fc6-b5f7-d9714d18a868 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:36.531211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f518cd-fa4e-4fc6-b5f7-d9714d18a868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:36.641218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-90f518cd-fa4e-4fc6-b5f7-d9714d18a868 None None] MFA Rules not processed for user `90941df44bf8429da5a663bd4eb51e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:36.642798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-90f518cd-fa4e-4fc6-b5f7-d9714d18a868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:36.713543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:36.804479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:36.893485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 852/1714] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:36.935123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:36.936890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:37.074135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da8066-3ee3-4012-aca3-2cf1d30a7771 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:37.092107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96499ca6-a000-41d0-bfd5-9f04746ea81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:37.092665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499ca6-a000-41d0-bfd5-9f04746ea81f service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:37.092954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499ca6-a000-41d0-bfd5-9f04746ea81f service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:37.095368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96499ca6-a000-41d0-bfd5-9f04746ea81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:37.117160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499ca6-a000-41d0-bfd5-9f04746ea81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:37.120814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96499ca6-a000-41d0-bfd5-9f04746ea81f service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:37.154272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 863/1715] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:37.520212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40360b44-a546-43f6-954f-65671ee7e7e2 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:37.520610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40360b44-a546-43f6-954f-65671ee7e7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:37.520980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40360b44-a546-43f6-954f-65671ee7e7e2 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:37.522845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 853/1716] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 28 08:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:37.531925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde478a-d692-46ea-be67-bcaf8dc82b27 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:37.532356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde478a-d692-46ea-be67-bcaf8dc82b27 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:37.532723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde478a-d692-46ea-be67-bcaf8dc82b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:37.590297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-7dde478a-d692-46ea-be67-bcaf8dc82b27 None None] MFA Rules not processed for user `5523644021bf4d91a3a9246bee763b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:37.593685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7dde478a-d692-46ea-be67-bcaf8dc82b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:37.739263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 864/1717] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:49:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:37.799720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40360b44-a546-43f6-954f-65671ee7e7e2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:37.801467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-40360b44-a546-43f6-954f-65671ee7e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:37.829957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40360b44-a546-43f6-954f-65671ee7e7e2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:37.840398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e55106-d38a-4512-a6ca-d70abd3c019b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:37.841339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55106-d38a-4512-a6ca-d70abd3c019b service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:37.841833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55106-d38a-4512-a6ca-d70abd3c019b service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:37.842275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55106-d38a-4512-a6ca-d70abd3c019b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:37.857946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e55106-d38a-4512-a6ca-d70abd3c019b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:37.865472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e55106-d38a-4512-a6ca-d70abd3c019b service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:37.893452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 854/1718] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:38.170918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:38.256672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:38.645019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199bf4-f4ef-4db3-ba1c-5c24e4eccee8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:38.645306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199bf4-f4ef-4db3-ba1c-5c24e4eccee8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:38.645584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199bf4-f4ef-4db3-ba1c-5c24e4eccee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:38.777631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fc199bf4-f4ef-4db3-ba1c-5c24e4eccee8 None None] MFA Rules not processed for user `b856793f2f0a453eb9e7c89dfe5f91b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:38.782323 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fc199bf4-f4ef-4db3-ba1c-5c24e4eccee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:38.818209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007a15-e7e2-4666-8fa5-6948831bcd03 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:38.818779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007a15-e7e2-4666-8fa5-6948831bcd03 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:38.819228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007a15-e7e2-4666-8fa5-6948831bcd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:38.905495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-80007a15-e7e2-4666-8fa5-6948831bcd03 None None] MFA Rules not processed for user `0150a12ff77b433496b370fa47f0dbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:38.907600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-80007a15-e7e2-4666-8fa5-6948831bcd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:39.033498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 865/1719] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:38 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:39.033498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199bf4-f4ef-4db3-ba1c-5c24e4eccee8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:39.071690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 855/1720] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:39.074480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a759-c7f7-4fe8-8687-3ec2987eea61 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:39.074768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a759-c7f7-4fe8-8687-3ec2987eea61 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:39.080265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a759-c7f7-4fe8-8687-3ec2987eea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:39.095354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199bf4-f4ef-4db3-ba1c-5c24e4eccee8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:39.126874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90941df44bf8429da5a663bd4eb51e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e9da30f3c4483f83f0b481d2939e5c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:39.126874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:39.126874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:39.129782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:39.130749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:39.135375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:39.139092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:39.196616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ab78a759-c7f7-4fe8-8687-3ec2987eea61 None None] MFA Rules not processed for user `a2b1f29c3a20499ea9ecbbd9dfcbd231`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:39.197852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ab78a759-c7f7-4fe8-8687-3ec2987eea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:39.234908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 866/1721] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:39.235896 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:39.459825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 856/1722] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:39.479840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a759-c7f7-4fe8-8687-3ec2987eea61 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:39.484680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff77fe-41fa-450b-b268-cca3e2a26b4c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:39.500531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:39.501454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:39.501904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:39.502377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:39.505749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a759-c7f7-4fe8-8687-3ec2987eea61 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:39.514892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554138-b12d-4e57-af2d-b26f04f4d586 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90941df44bf8429da5a663bd4eb51e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e9da30f3c4483f83f0b481d2939e5c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:39.515908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554138-b12d-4e57-af2d-b26f04f4d586 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:39.516445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554138-b12d-4e57-af2d-b26f04f4d586 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:39.518195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554138-b12d-4e57-af2d-b26f04f4d586 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:39.519390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554138-b12d-4e57-af2d-b26f04f4d586 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:39.522896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554138-b12d-4e57-af2d-b26f04f4d586 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:39.528046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:39.534054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:39.549846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 867/1723] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:39.587672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:39.587672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:39.673556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 857/1724] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:39 2022] POST /identity/v3/projects => generated 354 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:39.673556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589fa68-585f-44f0-9ec1-1233f0d0f6f2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:39.673556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589fa68-585f-44f0-9ec1-1233f0d0f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:39.673831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589fa68-585f-44f0-9ec1-1233f0d0f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:39.720581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8589fa68-585f-44f0-9ec1-1233f0d0f6f2 None None] MFA Rules not processed for user `a2b1f29c3a20499ea9ecbbd9dfcbd231`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:39.722163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8589fa68-585f-44f0-9ec1-1233f0d0f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:39.890534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52410-19b4-468d-9130-9ec93e0a9dab service nova] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:39.971704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 858/1725] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:39.973717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e49f-989f-4b8c-b635-5fcd157b170a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:39.974161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e49f-989f-4b8c-b635-5fcd157b170a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:39.974638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e49f-989f-4b8c-b635-5fcd157b170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:40.010956 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0d17e49f-989f-4b8c-b635-5fcd157b170a None None] MFA Rules not processed for user `86312e5441df4cf89028fbe807bef5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:40.013804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0d17e49f-989f-4b8c-b635-5fcd157b170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:40.097983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:40.098881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:40.099162 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:40.099453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:40.111716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:40.164409 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:40.167882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:40.199812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 868/1726] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:40.200692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:40.211473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 859/1727] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:40.212443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17e49f-989f-4b8c-b635-5fcd157b170a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:40.302258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:40.462715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:40.464343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17e49f-989f-4b8c-b635-5fcd157b170a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:40.481078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:40.483149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:40.483454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:40.483750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:40.495164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c98bec-3bd4-4851-8941-d90170ddb63a service placement] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:40.499045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:40.500929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:40.511666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 860/1728] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:40.524069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781071-5b8f-4140-8ec3-f4b29d219531 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90941df44bf8429da5a663bd4eb51e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e9da30f3c4483f83f0b481d2939e5c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:40.524790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781071-5b8f-4140-8ec3-f4b29d219531 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:40.525077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781071-5b8f-4140-8ec3-f4b29d219531 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:40.525355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781071-5b8f-4140-8ec3-f4b29d219531 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:40.526027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781071-5b8f-4140-8ec3-f4b29d219531 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:40.526335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781071-5b8f-4140-8ec3-f4b29d219531 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:40.528027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781071-5b8f-4140-8ec3-f4b29d219531 tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:40.589640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 869/1729] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:40.694042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:40.717467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2dabb-a86e-4909-a7f1-d6b115361b92 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:40.739862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90941df44bf8429da5a663bd4eb51e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e9da30f3c4483f83f0b481d2939e5c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:40.745182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:40.745476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:40.745758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] PATH_INFO: `/v3/projects/8063b459862a467793cc2fa6dfe1c27c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:40.765510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8063b459862a467793cc2fa6dfe1c27c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:40.767531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:41.226544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8063b459862a467793cc2fa6dfe1c27c', 'request_id': 'req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:41.226544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8063b459862a467793cc2fa6dfe1c27c', 'request_id': 'req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:41.283510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8063b459862a467793cc2fa6dfe1c27c', 'request_id': 'req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:41.308190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] The token cache is being invalidate because project 8063b459862a467793cc2fa6dfe1c27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:41.308731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:41.314476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f4b5a961-84dc-43e2-9b36-8ae32abcbf9c tempest-VolumeQuotaClassesTest-1168001397 tempest-VolumeQuotaClassesTest-1168001397-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:41.329806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 861/1730] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:40 2022] DELETE /identity/v3/projects/8063b459862a467793cc2fa6dfe1c27c => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:41.464216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0aab-a966-4311-b3a2-e89228c9af2f None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:41.466568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0aab-a966-4311-b3a2-e89228c9af2f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:41.466568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe0aab-a966-4311-b3a2-e89228c9af2f None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:41.466568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 870/1731] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 28 08:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:41.475828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071c9e-5a0e-4de0-8b46-9d48460f7d0a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:41.478439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071c9e-5a0e-4de0-8b46-9d48460f7d0a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:41.479771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:41.480522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071c9e-5a0e-4de0-8b46-9d48460f7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:41.522510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-78071c9e-5a0e-4de0-8b46-9d48460f7d0a None None] MFA Rules not processed for user `5523644021bf4d91a3a9246bee763b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:41.525417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-78071c9e-5a0e-4de0-8b46-9d48460f7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:41.707597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 862/1732] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:41.714950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9d0a-0dd0-4f5f-8f4c-9cdd97089335 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:41.715240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9d0a-0dd0-4f5f-8f4c-9cdd97089335 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:41.715677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9d0a-0dd0-4f5f-8f4c-9cdd97089335 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:41.717721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 871/1733] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:41.738552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a659a5-c2a4-4e4e-afc5-683f1fc0a26c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:41.738756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a659a5-c2a4-4e4e-afc5-683f1fc0a26c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:41.739008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a659a5-c2a4-4e4e-afc5-683f1fc0a26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:41.754224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9d0a-0dd0-4f5f-8f4c-9cdd97089335 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:41.757441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-47bc9d0a-0dd0-4f5f-8f4c-9cdd97089335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:41.797920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9d0a-0dd0-4f5f-8f4c-9cdd97089335 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:41.798537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-71a659a5-c2a4-4e4e-afc5-683f1fc0a26c None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:41.800774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-71a659a5-c2a4-4e4e-afc5-683f1fc0a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:41.803342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9536a-5517-459f-bbf8-b3d9df0d9ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:41.804817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9536a-5517-459f-bbf8-b3d9df0d9ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:41.805131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9536a-5517-459f-bbf8-b3d9df0d9ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:41.805406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9536a-5517-459f-bbf8-b3d9df0d9ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:41.832152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9536a-5517-459f-bbf8-b3d9df0d9ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:41.833604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9536a-5517-459f-bbf8-b3d9df0d9ff3 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:41.871516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 872/1734] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:49:41.996881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 863/1735] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:42.061639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b71d-ec45-4d17-be41-49f6317e3d8e None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:42.061982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b71d-ec45-4d17-be41-49f6317e3d8e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:42.070541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584b71d-ec45-4d17-be41-49f6317e3d8e None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:42.070541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 873/1736] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 28 08:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:42.071901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:42.072284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:42.072654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:42.142777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:42.146580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:42.232407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584b71d-ec45-4d17-be41-49f6317e3d8e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:42.256181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 864/1737] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 28 08:49:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:42.256827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584b71d-ec45-4d17-be41-49f6317e3d8e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:42.263092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:42.264181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:42.264562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:42.264930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:42.278432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:42.284797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:42.320599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 874/1738] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:42.605060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:42.829071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:42.831373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:42.881343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:43.028210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7c7c8-8ffa-4902-88e8-1198da3ad90f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:43.041094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:43.041917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:43.042303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:43.045478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] PATH_INFO: `/v3/users/b12dc83834c844b88d27775a2e11155f` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:43.047258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12dc83834c844b88d27775a2e11155f)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:43.050418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:43.164868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:43.166389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:43.198142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9570-640b-4e8e-b6dd-c4476ea60dc2 service placement] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:43.207971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:43.208649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:43.208929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:43.211098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] PATH_INFO: `/v3/users/c71a4e06024e4a33af9e1675545c8511` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:43.212414 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71a4e06024e4a33af9e1675545c8511)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:43.217185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:43.301567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12dc83834c844b88d27775a2e11155f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.302528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12dc83834c844b88d27775a2e11155f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.334263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12dc83834c844b88d27775a2e11155f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.456943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12dc83834c844b88d27775a2e11155f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.458122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b0648ddb-b324-458e-a7d0-7bc0ac38a314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12dc83834c844b88d27775a2e11155f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.484961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 865/1739] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:42 2022] DELETE /identity/v3/users/b12dc83834c844b88d27775a2e11155f => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:43.486738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71a4e06024e4a33af9e1675545c8511'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.488949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71a4e06024e4a33af9e1675545c8511'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.500162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560763-a5d7-4eef-b1ef-c576d76db557 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:43.501465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560763-a5d7-4eef-b1ef-c576d76db557 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:43.505734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560763-a5d7-4eef-b1ef-c576d76db557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:43.533972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71a4e06024e4a33af9e1675545c8511'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.581515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-25560763-a5d7-4eef-b1ef-c576d76db557 None None] MFA Rules not processed for user `ef12fbaea8c14f548429b3733840ceeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:43.581515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-25560763-a5d7-4eef-b1ef-c576d76db557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:43.666925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71a4e06024e4a33af9e1675545c8511'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.668308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9705bff8-8711-42b9-b158-7e18562441bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71a4e06024e4a33af9e1675545c8511'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:43.696403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 875/1740] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:43 2022] DELETE /identity/v3/users/c71a4e06024e4a33af9e1675545c8511 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:49:43.697941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:43.698375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:43.698790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:43.736173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:43.748931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:43.750426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:43.786002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 866/1741] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:43.791512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:43.791952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:43.792462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:43.841607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:43.856821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:43.984633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 876/1742] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:44.058532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 867/1743] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:44.076613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:44.078478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:44.118086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:44.119625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:44.219375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7046e91-afa7-409b-a82d-a8e0f338dc02 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:44.232991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7a593-79b3-4f87-9d81-f8d175a22dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:44.233799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7a593-79b3-4f87-9d81-f8d175a22dbd service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:44.241040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7a593-79b3-4f87-9d81-f8d175a22dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:44.241040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7a593-79b3-4f87-9d81-f8d175a22dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:44.256617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fe923-8f1f-43bf-81f9-7b4ed7fb9f53 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:44.262098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7a593-79b3-4f87-9d81-f8d175a22dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:44.264982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7a593-79b3-4f87-9d81-f8d175a22dbd service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:44.274346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:44.275486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:44.275486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:44.275661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:44.297980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 877/1744] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:44.302242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc964c-9ff8-48df-b165-bd848a461522 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:44.302772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc964c-9ff8-48df-b165-bd848a461522 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:44.306886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:44.307031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc964c-9ff8-48df-b165-bd848a461522 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:44.310062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 878/1745] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:49:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:44.310251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:44.341648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:44.342463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:44.343106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:44.352334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 868/1746] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:44.353303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:44.355642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:44.381787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375dfa-a71e-412a-ba83-0997c36a8cda service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:44.395458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:44.396276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:44.396726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:44.397179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] PATH_INFO: `/v3/users/4aa1bac7a7ce4430a5b1e5b6d948cf87` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:44.398414 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] MFA Rules not processed for user `4b79ca72535543aeac33b949189ee4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:44.399058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa1bac7a7ce4430a5b1e5b6d948cf87)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:44.400506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:44.401115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:44.614489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 879/1747] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:49:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:44.737145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa1bac7a7ce4430a5b1e5b6d948cf87'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:44.739104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa1bac7a7ce4430a5b1e5b6d948cf87'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:44.792973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa1bac7a7ce4430a5b1e5b6d948cf87'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:44.861386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa1bac7a7ce4430a5b1e5b6d948cf87'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:44.862549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa1bac7a7ce4430a5b1e5b6d948cf87'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:44.877740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 869/1748] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:44 2022] DELETE /identity/v3/users/4aa1bac7a7ce4430a5b1e5b6d948cf87 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:44.885062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:44.889482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:44.947194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bc49-d7e7-4d3b-be27-d9b3e9e3617e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:44.960775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:45.160829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:45.161472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:45.161765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:45.162025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:45.176034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:45.195876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:45.201281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:45.221733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:45.226856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 880/1749] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:45.583884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:45.585946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:45.712750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7449a-565c-447e-8543-0ebb02fa0757 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:45.720942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:45.721895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:45.722486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:45.722943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] PATH_INFO: `/v3/projects/c9873f77e0674315b4a6fccb7b43cfb0` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:45.725080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9873f77e0674315b4a6fccb7b43cfb0)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:45.748135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:45.936315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9873f77e0674315b4a6fccb7b43cfb0', 'request_id': 'req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:45.954654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9873f77e0674315b4a6fccb7b43cfb0', 'request_id': 'req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.033120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9873f77e0674315b4a6fccb7b43cfb0', 'request_id': 'req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.051478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] The token cache is being invalidate because project c9873f77e0674315b4a6fccb7b43cfb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:46.051958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.054907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.058923 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 870/1750] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:45 2022] DELETE /identity/v3/projects/c9873f77e0674315b4a6fccb7b43cfb0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:46.063149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:46.082678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:46.085967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:46.089233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecea374-2daf-4206-b5b0-bca6828a0517 service placement] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:46.265714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:46.266999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:46.267605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:46.268135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] PATH_INFO: `/v3/users/b856793f2f0a453eb9e7c89dfe5f91b8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:46.270600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c7c8-54c7-46a6-93b7-cad1e7a95bef admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:46.276492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b856793f2f0a453eb9e7c89dfe5f91b8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:46.278789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:46.295365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:46.297376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:46.297376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:46.297376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] PATH_INFO: `/v3/projects/ce23ce46606a400c9cb6deeaae810d62` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:46.311158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce23ce46606a400c9cb6deeaae810d62)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:46.318750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:46.614410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b856793f2f0a453eb9e7c89dfe5f91b8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.615770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b856793f2f0a453eb9e7c89dfe5f91b8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.619639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce23ce46606a400c9cb6deeaae810d62', 'request_id': 'req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.647042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce23ce46606a400c9cb6deeaae810d62', 'request_id': 'req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.659787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b856793f2f0a453eb9e7c89dfe5f91b8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.730084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce23ce46606a400c9cb6deeaae810d62', 'request_id': 'req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.752517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] The token cache is being invalidate because project ce23ce46606a400c9cb6deeaae810d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:46.753420 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.755672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.761711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 871/1751] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:46 2022] DELETE /identity/v3/projects/ce23ce46606a400c9cb6deeaae810d62 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:46.765304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:46.767476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:46.847018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b856793f2f0a453eb9e7c89dfe5f91b8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.849707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-be0bda52-2b75-41fb-8b3b-87bb4443afd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b856793f2f0a453eb9e7c89dfe5f91b8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:46.889388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 881/1752] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:46 2022] DELETE /identity/v3/users/b856793f2f0a453eb9e7c89dfe5f91b8 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:49:46.890958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:46.891437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:46.891859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:46.995641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6ecd8-85cf-4a29-b7a7-2f1de0ee8d3f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:47.101354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:47.104621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:47.205293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:47.205293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:47.205293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:47.205293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] PATH_INFO: `/v3/projects/b9ac37a4082341a0896639547c4049a8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:47.205681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ac37a4082341a0896639547c4049a8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:47.208423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:47.350447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 882/1753] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:49:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:47.360518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:47.362704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:47.389948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875164dd-7e09-4aef-857a-f820ede5e66e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:47.396588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:47.397691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:47.398415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:47.398415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] PATH_INFO: `/v3/users/cd43263adbd046fd95940236536b0086` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:47.399456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd43263adbd046fd95940236536b0086)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:47.401678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:47.534841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ac37a4082341a0896639547c4049a8', 'request_id': 'req-77a76580-e93e-4e3d-a97a-038748a72feb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.558447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ac37a4082341a0896639547c4049a8', 'request_id': 'req-77a76580-e93e-4e3d-a97a-038748a72feb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.715332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:47.763185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ac37a4082341a0896639547c4049a8', 'request_id': 'req-77a76580-e93e-4e3d-a97a-038748a72feb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.785585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] The token cache is being invalidate because project b9ac37a4082341a0896639547c4049a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:47.785889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.789676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-77a76580-e93e-4e3d-a97a-038748a72feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.794369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 872/1754] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:46 2022] DELETE /identity/v3/projects/b9ac37a4082341a0896639547c4049a8 => generated 0 bytes in 1032 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:47.795984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd43263adbd046fd95940236536b0086'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.796103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:47.796290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:47.797763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd43263adbd046fd95940236536b0086'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.798625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:47.828901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd43263adbd046fd95940236536b0086'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.858177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] MFA Rules not processed for user `0150a12ff77b433496b370fa47f0dbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:47.859445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:47.887755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:47.919874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd43263adbd046fd95940236536b0086'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.925604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd43263adbd046fd95940236536b0086'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:47.947237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 873/1755] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:47.949026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:47.950006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 883/1756] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:47 2022] DELETE /identity/v3/users/cd43263adbd046fd95940236536b0086 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:47.951001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:47.953618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:47.957961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:48.167936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682929-91b8-4bde-977f-62c8389a4111 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:48.170390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fcfbb-21c3-4c7d-806c-490801a19537 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:48.186430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:48.187098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:48.187386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:48.187700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] PATH_INFO: `/v3/projects/f07fbdb580bd416fa2a009fa0c8e95fc` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:48.188101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:48.189689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07fbdb580bd416fa2a009fa0c8e95fc)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:48.189906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:48.190255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:48.190535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] PATH_INFO: `/v3/users/90941df44bf8429da5a663bd4eb51e58` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:48.191751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:48.192558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90941df44bf8429da5a663bd4eb51e58)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:48.196431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:48.369792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07fbdb580bd416fa2a009fa0c8e95fc', 'request_id': 'req-ece924db-6efa-4263-9d5e-870185f3eaf8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.382928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07fbdb580bd416fa2a009fa0c8e95fc', 'request_id': 'req-ece924db-6efa-4263-9d5e-870185f3eaf8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.479336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07fbdb580bd416fa2a009fa0c8e95fc', 'request_id': 'req-ece924db-6efa-4263-9d5e-870185f3eaf8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.497165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] The token cache is being invalidate because project f07fbdb580bd416fa2a009fa0c8e95fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:48.499307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.501604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.509879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 884/1757] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:47 2022] DELETE /identity/v3/projects/f07fbdb580bd416fa2a009fa0c8e95fc => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:48.511101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:48.520030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:48.616025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90941df44bf8429da5a663bd4eb51e58'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.619931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90941df44bf8429da5a663bd4eb51e58'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.661374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90941df44bf8429da5a663bd4eb51e58'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.786235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90941df44bf8429da5a663bd4eb51e58'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.787769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c262a73d-593f-479d-a1df-f1e26fa80520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90941df44bf8429da5a663bd4eb51e58'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:48.822633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 874/1758] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:49:47 2022] DELETE /identity/v3/users/90941df44bf8429da5a663bd4eb51e58 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:48.824326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8f3f7-deb3-45a1-80a4-d72b84ad1437 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:48.824811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8f3f7-deb3-45a1-80a4-d72b84ad1437 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:48.825331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8f3f7-deb3-45a1-80a4-d72b84ad1437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:48.878736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-81e8f3f7-deb3-45a1-80a4-d72b84ad1437 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:48.880274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-81e8f3f7-deb3-45a1-80a4-d72b84ad1437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:48.884359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece924db-6efa-4263-9d5e-870185f3eaf8 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:48.997910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891bd49-9e3e-4018-b631-e8634306f1f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:48.998840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891bd49-9e3e-4018-b631-e8634306f1f4 service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:48.999763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891bd49-9e3e-4018-b631-e8634306f1f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:49.000196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891bd49-9e3e-4018-b631-e8634306f1f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:49.003806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0891bd49-9e3e-4018-b631-e8634306f1f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:49.070399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 875/1759] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:49.075459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ebeb-579a-4e4d-b9fa-6573869482d9 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:49.079910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ebeb-579a-4e4d-b9fa-6573869482d9 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:49.080620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ebeb-579a-4e4d-b9fa-6573869482d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:49.146624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5617ebeb-579a-4e4d-b9fa-6573869482d9 None None] MFA Rules not processed for user `5523644021bf4d91a3a9246bee763b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:49.153517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5617ebeb-579a-4e4d-b9fa-6573869482d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:49.155335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891bd49-9e3e-4018-b631-e8634306f1f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:49.157909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891bd49-9e3e-4018-b631-e8634306f1f4 service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:49.177503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 885/1760] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:49:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:49.179481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabcbed-1654-47af-aa28-496b80ae0c9f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:49.179778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabcbed-1654-47af-aa28-496b80ae0c9f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:49.183144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabcbed-1654-47af-aa28-496b80ae0c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:49.295253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 876/1761] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Sep 28 08:49:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:49.328091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-feabcbed-1654-47af-aa28-496b80ae0c9f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:49.328091 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-feabcbed-1654-47af-aa28-496b80ae0c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:49.378133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ebeb-579a-4e4d-b9fa-6573869482d9 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:49.384738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 886/1762] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:49.410785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ebeb-579a-4e4d-b9fa-6573869482d9 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:49.423979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:49.424806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:49.425897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:49.427082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:49.430222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:49.430536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:49.432276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:49.467223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabcbed-1654-47af-aa28-496b80ae0c9f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:49.476489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 877/1763] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:49:49.479679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabcbed-1654-47af-aa28-496b80ae0c9f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:49.492490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:49.493434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:49.494088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:49.494534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:49.495638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:49.497992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:49.541625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=17,keystone:SELECT=82,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:49.601140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:49.605768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:49.633143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 887/1764] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:49 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:49.638773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:49.662795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12a5f-eb18-4532-a561-fc5157348bde admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:49.855763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:49.856393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:49.856673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:49.856946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:49.863268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2c34-861a-4782-a33f-6457dfcca8d5 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:49.871641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:49.873744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:49.875450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:49.876125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:49.876425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:49.876702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:49.877675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:49.882858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:49.907181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 878/1765] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:49:49.989038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:49.995750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:50.056006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 888/1766] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:49 2022] POST /identity/v3/users => generated 283 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:50.059709 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:50.081249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfc07c-8848-47c3-95c4-10d408899f0a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:50.092562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697384-b111-4f64-bb0b-b6f269dead55 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:50.107296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:50.108003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:50.108282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:50.108557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] PATH_INFO: `/v3/projects/c6824008c22540849e3c4efa2c2bde6a` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:50.110910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6824008c22540849e3c4efa2c2bde6a)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:50.118004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:50.122139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:50.122139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:50.122519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:50.122700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:50.127909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:50.137988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:50.193990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 889/1767] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:50.206903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:50.246460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97074814-bc0b-4273-a6a2-a57e4d792da5 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:50.273837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:50.274352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:50.274633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:50.274903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:50.275581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:50.289473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:50.354267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 890/1768] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:50.356104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:50.369358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6824008c22540849e3c4efa2c2bde6a', 'request_id': 'req-2a868033-b7d1-42a3-af64-581d9d8acf18'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:50.388171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:50.390699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6824008c22540849e3c4efa2c2bde6a', 'request_id': 'req-2a868033-b7d1-42a3-af64-581d9d8acf18'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:50.408638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ca5cf-a257-4f79-8f35-89f4e9671237 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:50.535232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6824008c22540849e3c4efa2c2bde6a', 'request_id': 'req-2a868033-b7d1-42a3-af64-581d9d8acf18'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:50.612090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] The token cache is being invalidate because project c6824008c22540849e3c4efa2c2bde6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:50.633067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:50.635887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f3fe1-ecce-4b56-b90a-fac83f3e66a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:50.636615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f3fe1-ecce-4b56-b90a-fac83f3e66a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:50.636908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f3fe1-ecce-4b56-b90a-fac83f3e66a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:50.637184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f3fe1-ecce-4b56-b90a-fac83f3e66a7 admin admin] PATH_INFO: `/v3/projects/850e4b9bf7e34f29bcd239ba9dc23c2d/users/b58fc96c26c14ffc9a862d00ddd92a31/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:50.637284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2a868033-b7d1-42a3-af64-581d9d8acf18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:50.641482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 879/1769] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:49 2022] DELETE /identity/v3/projects/c6824008c22540849e3c4efa2c2bde6a => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:50.659341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401dd5-0602-46dc-b36b-e21d5db265d3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:50.669600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401dd5-0602-46dc-b36b-e21d5db265d3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:50.669889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401dd5-0602-46dc-b36b-e21d5db265d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:50.686744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f3fe1-ecce-4b56-b90a-fac83f3e66a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850e4b9bf7e34f29bcd239ba9dc23c2d, user_id=b58fc96c26c14ffc9a862d00ddd92a31, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:50.701822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f3fe1-ecce-4b56-b90a-fac83f3e66a7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:50.849801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6c401dd5-0602-46dc-b36b-e21d5db265d3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:50.849801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6c401dd5-0602-46dc-b36b-e21d5db265d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:50.849801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 880/1770] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:50.857458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696d9f-8167-4f28-9861-242da11b8f29 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:50.858017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696d9f-8167-4f28-9861-242da11b8f29 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:50.858472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696d9f-8167-4f28-9861-242da11b8f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:50.874980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 891/1771] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:50 2022] PUT /identity/v3/projects/850e4b9bf7e34f29bcd239ba9dc23c2d/users/b58fc96c26c14ffc9a862d00ddd92a31/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:50.892773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:50.893227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:50.893418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:50.918130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d4696d9f-8167-4f28-9861-242da11b8f29 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:50.923585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d4696d9f-8167-4f28-9861-242da11b8f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:50.952144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] MFA Rules not processed for user `b58fc96c26c14ffc9a862d00ddd92a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:50.953695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:51.155538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 892/1772] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:51.156521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:51.160135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:51.247216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 881/1773] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:49:51.250731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4696d9f-8167-4f28-9861-242da11b8f29 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:51.267439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4696d9f-8167-4f28-9861-242da11b8f29 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:51.290007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:51.290657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:51.290948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:51.291227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:51.291991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:51.292303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:51.294511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:51.322390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 882/1774] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:51.326702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:51.361848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2596a-bede-4e2e-a14c-14ea86fd53f7 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:51.380373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:51.382270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:51.382707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:51.383200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:51.384042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:51.391234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:51.447633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba35aa8-f290-4de9-9af7-bf66bf514285 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:51.461683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:51.462383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:51.464110 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:51.465518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:51.467705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:51.483843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:51.571199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 883/1775] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:51 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:49:51.574342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:51.669432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 893/1776] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:51 2022] POST /identity/v3/projects => generated 365 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:51.674812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:51.789155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:51.812583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f39c-466f-467b-a4f9-bfbdabdff9de admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:51.911222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be013e-19af-4057-b72f-fd1eef540785 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:51.929339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:51.930517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:51.931055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:51.931557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:51.932404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:51.934681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.045033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.045751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.046084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.046364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.047009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.059744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.106584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 894/1777] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:51 2022] POST /identity/v3/users => generated 289 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:52.111338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:52.146324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b665f-3e90-4820-911c-d9c405ffad1f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:52.173690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.174479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 884/1778] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:51 2022] POST /identity/v3/users => generated 290 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:52.175447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:52.178054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.180156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.181280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.184264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.191054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.200912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b47b1d-c9d0-4343-949b-00b81946bad1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:52.220450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.220861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.221121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.221395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.222044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.224071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.232773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 895/1779] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:49:52.234062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:52.260619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cf9c2-b533-49eb-86ff-8970aa70c010 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:52.262046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 885/1780] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:52.263048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:52.275111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.276895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.277762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.278125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] PATH_INFO: `/v3/projects/4582cebd5bf2484db4928694758d3d60/users/b9ed8aa692454fbb937560bf0abd8f0b/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.298233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b380-b8d1-42a2-938c-7251eb019b8b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:52.308020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.308727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.309010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.309286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.309983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.311705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4582cebd5bf2484db4928694758d3d60, user_id=b9ed8aa692454fbb937560bf0abd8f0b, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.314665 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.315032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.359031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 886/1781] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:52.360084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:52.388571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f6b9a-2df5-4efe-81b4-e2f0ebdedb31 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:52.397208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.397843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.398126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.398398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] PATH_INFO: `/v3/projects/44da2df865684b639bd8f3fc6725a111/users/c9b283499bbc4e0c92a56d65844fe8dd/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.422815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 896/1782] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:52 2022] PUT /identity/v3/projects/4582cebd5bf2484db4928694758d3d60/users/b9ed8aa692454fbb937560bf0abd8f0b/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:52.424256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:52.427189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:52.434702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44da2df865684b639bd8f3fc6725a111, user_id=c9b283499bbc4e0c92a56d65844fe8dd, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.437784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.578079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 887/1783] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:52 2022] PUT /identity/v3/projects/44da2df865684b639bd8f3fc6725a111/users/c9b283499bbc4e0c92a56d65844fe8dd/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:52.578079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:52.630163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26322616-39da-4fd8-aeff-4e35bbce6f56 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:52.718142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31c557-eb81-481a-85e7-eae8c35d10a6 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:52.723843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61400b-447d-4015-ac18-85d404f00183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.724474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61400b-447d-4015-ac18-85d404f00183 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.724753 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61400b-447d-4015-ac18-85d404f00183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.725023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61400b-447d-4015-ac18-85d404f00183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.726374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61400b-447d-4015-ac18-85d404f00183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.728343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61400b-447d-4015-ac18-85d404f00183 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.765318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 888/1784] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:52.765318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e5d7-f535-4a02-9e5f-f3388583a4c5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.765318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e5d7-f535-4a02-9e5f-f3388583a4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.765724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e5d7-f535-4a02-9e5f-f3388583a4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.816735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:52.817507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:52.817796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:52.818245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] PATH_INFO: `/v3/projects/22e9da30f3c4483f83f0b481d2939e5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:52.819812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e9da30f3c4483f83f0b481d2939e5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:52.822463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:52.869210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-87e6e5d7-f535-4a02-9e5f-f3388583a4c5 None None] MFA Rules not processed for user `c9b283499bbc4e0c92a56d65844fe8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:52.870750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-87e6e5d7-f535-4a02-9e5f-f3388583a4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:53.018618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e9da30f3c4483f83f0b481d2939e5c', 'request_id': 'req-b71a8622-8ec6-42e2-9964-1cb278e28098'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:53.034535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e9da30f3c4483f83f0b481d2939e5c', 'request_id': 'req-b71a8622-8ec6-42e2-9964-1cb278e28098'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:53.052314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 889/1785] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:53.052314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e5d7-f535-4a02-9e5f-f3388583a4c5 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:53.078254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e5d7-f535-4a02-9e5f-f3388583a4c5 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:53.144508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e9da30f3c4483f83f0b481d2939e5c', 'request_id': 'req-b71a8622-8ec6-42e2-9964-1cb278e28098'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:53.198045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] The token cache is being invalidate because project 22e9da30f3c4483f83f0b481d2939e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:49:53.198354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:53.199071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:49:53.201015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 897/1786] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:49:52 2022] DELETE /identity/v3/projects/22e9da30f3c4483f83f0b481d2939e5c => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:53.218252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:53.226136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:53.239158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:53.348072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a8622-8ec6-42e2-9964-1cb278e28098 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:53.364152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aa8d7-bc19-420a-9e45-325b65fbefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:53.367239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa8d7-bc19-420a-9e45-325b65fbefac admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.367239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa8d7-bc19-420a-9e45-325b65fbefac admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.367239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa8d7-bc19-420a-9e45-325b65fbefac admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.367239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aa8d7-bc19-420a-9e45-325b65fbefac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:53.368088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751d7e6-ebe6-4621-b2ed-446fe7d388c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:53.368294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aa8d7-bc19-420a-9e45-325b65fbefac admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:53.369124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751d7e6-ebe6-4621-b2ed-446fe7d388c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.371280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751d7e6-ebe6-4621-b2ed-446fe7d388c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.372040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751d7e6-ebe6-4621-b2ed-446fe7d388c7 admin admin] PATH_INFO: `/v3/projects/4582cebd5bf2484db4928694758d3d60/users/b9ed8aa692454fbb937560bf0abd8f0b/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.380267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751d7e6-ebe6-4621-b2ed-446fe7d388c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4582cebd5bf2484db4928694758d3d60, user_id=b9ed8aa692454fbb937560bf0abd8f0b, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:53.387907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751d7e6-ebe6-4621-b2ed-446fe7d388c7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:53.422745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 890/1787] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:53 2022] PUT /identity/v3/projects/4582cebd5bf2484db4928694758d3d60/users/b9ed8aa692454fbb937560bf0abd8f0b/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:53.445515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8f4e6-a5b2-4b6d-b905-c4dd0480075e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.446296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8f4e6-a5b2-4b6d-b905-c4dd0480075e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.450553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8f4e6-a5b2-4b6d-b905-c4dd0480075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.511385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 898/1788] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:53 2022] POST /identity/v3/projects => generated 377 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:53.513383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267c07f-a0f5-4a0d-a5bc-e892c6ff993b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.515596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267c07f-a0f5-4a0d-a5bc-e892c6ff993b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.516189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267c07f-a0f5-4a0d-a5bc-e892c6ff993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.559004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-32c8f4e6-a5b2-4b6d-b905-c4dd0480075e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:53.561760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-32c8f4e6-a5b2-4b6d-b905-c4dd0480075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:53.604065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8267c07f-a0f5-4a0d-a5bc-e892c6ff993b None None] MFA Rules not processed for user `b9ed8aa692454fbb937560bf0abd8f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:53.605482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8267c07f-a0f5-4a0d-a5bc-e892c6ff993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:53.728798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 891/1789] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:53.729938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8f4e6-a5b2-4b6d-b905-c4dd0480075e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:53.742021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8f4e6-a5b2-4b6d-b905-c4dd0480075e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:53.749141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a78e7-5613-41cf-8de7-e3e48f3d44a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:53.750242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a78e7-5613-41cf-8de7-e3e48f3d44a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.750809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a78e7-5613-41cf-8de7-e3e48f3d44a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.751179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a78e7-5613-41cf-8de7-e3e48f3d44a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.751870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a78e7-5613-41cf-8de7-e3e48f3d44a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:53.754631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a78e7-5613-41cf-8de7-e3e48f3d44a9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:53.827898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 899/1790] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:53.830040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e960-14ba-4f41-9ac3-de09bac2e354 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.830486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e960-14ba-4f41-9ac3-de09bac2e354 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.830917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e960-14ba-4f41-9ac3-de09bac2e354 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.833039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 900/1791] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:53.834494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.835741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.836331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.876727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:53.881380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:53.895816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 892/1792] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:53 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:53.896999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360b34-6904-4902-a45d-bfdb1f89f60a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:53.897318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360b34-6904-4902-a45d-bfdb1f89f60a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:53.897596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360b34-6904-4902-a45d-bfdb1f89f60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:53.906260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 901/1793] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:53.907348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:53.909056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:53.954737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-fc360b34-6904-4902-a45d-bfdb1f89f60a None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:53.956072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fc360b34-6904-4902-a45d-bfdb1f89f60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:54.061915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d45c2-a8ec-46ca-aadc-3411fff4539a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.072973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.072973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.072973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.089773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.133965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.143187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.181025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 902/1794] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:54.187029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.202247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 893/1795] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:54.203658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360b34-6904-4902-a45d-bfdb1f89f60a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.210451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:54.216369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd06fc-44ff-49fe-9489-a90ff4423b1c service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.245359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.251607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.251607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.251607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.252167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360b34-6904-4902-a45d-bfdb1f89f60a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.252259 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.253808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.281455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.284003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.284003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.284003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.284003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:49:54.284003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.286132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.315930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 903/1796] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:54.324354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.337432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 894/1797] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:49:54.340943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.362586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f7f78-c0d0-49a4-b802-64085b22209d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.364069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d325b-61c4-4542-9568-2bf7aa9461bb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.370092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.370737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.371169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.371504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.372117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.390743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.400328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.401008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.401369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.401709 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] PATH_INFO: `/v3/projects/2cd4f0759a19428386c16c4ffe79a7f2/users/72f7b59d07e94aca8fd87bf3358d6723/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.443995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd4f0759a19428386c16c4ffe79a7f2, user_id=72f7b59d07e94aca8fd87bf3358d6723, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.446907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.542145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 895/1798] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:54 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:54.543591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.570116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 904/1799] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:54 2022] PUT /identity/v3/projects/2cd4f0759a19428386c16c4ffe79a7f2/users/72f7b59d07e94aca8fd87bf3358d6723/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:54.574370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.758142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc9ba8-25b0-4a2b-8a1f-2a845525a792 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.759021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f588c-db6c-43b9-be7a-3aa370eb947d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.766206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.768561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.768889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.769005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.769084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.769084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.769210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.769284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.769761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.771113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.771971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.775106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.798224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 905/1800] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:54.800618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.800735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:54.854689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 896/1801] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:54 2022] POST /identity/v3/users => generated 297 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:49:54.857162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.896857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f19a45-04eb-4cda-9a88-f39cf140cdef admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:54.935964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:54.939853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:54.939853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:54.939853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] PATH_INFO: `/v3/projects/2cd4f0759a19428386c16c4ffe79a7f2/users/72f7b59d07e94aca8fd87bf3358d6723/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:54.943989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd4f0759a19428386c16c4ffe79a7f2, user_id=72f7b59d07e94aca8fd87bf3358d6723, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:54.950850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:54.980953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 897/1802] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:54 2022] PUT /identity/v3/projects/2cd4f0759a19428386c16c4ffe79a7f2/users/72f7b59d07e94aca8fd87bf3358d6723/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:54.984223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:54.984933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ff096-d3ee-4a7c-8426-3fe9eebf54f0 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:55.075618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:55.077298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c40004-a980-49e0-94ba-15dd7de58ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:55.077447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40004-a980-49e0-94ba-15dd7de58ece service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.077731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40004-a980-49e0-94ba-15dd7de58ece service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.078009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40004-a980-49e0-94ba-15dd7de58ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.090778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f3c40004-a980-49e0-94ba-15dd7de58ece service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:55.154911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac49b11-51c0-4bfa-99c5-a66069e3b4ca admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:55.168542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:55.169373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.169875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.170292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.171160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:55.174009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:55.200781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 898/1803] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:55.203229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:55.206815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:55.233233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c40004-a980-49e0-94ba-15dd7de58ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:55.236521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c40004-a980-49e0-94ba-15dd7de58ece service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:55.262847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 906/1804] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:55.264371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a486-db1f-4d2e-841b-6a91af027004 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.264656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a486-db1f-4d2e-841b-6a91af027004 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.264932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a486-db1f-4d2e-841b-6a91af027004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.349786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d2a9a486-db1f-4d2e-841b-6a91af027004 None None] MFA Rules not processed for user `72f7b59d07e94aca8fd87bf3358d6723`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:55.352042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d2a9a486-db1f-4d2e-841b-6a91af027004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:55.456716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae76b4-2614-40bc-b5cc-41e2657b7384 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:55.477612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:55.478684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.479114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.480162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.518859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:55.518859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:55.533617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 899/1805] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:55.534503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:55.547523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66192252-c99d-4b77-ba81-8b0159ebb32c service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:55.555185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a6baf-fd11-499d-9cab-049f77d32194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:55.557129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a6baf-fd11-499d-9cab-049f77d32194 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.557129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a6baf-fd11-499d-9cab-049f77d32194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.557129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a6baf-fd11-499d-9cab-049f77d32194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.557431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a6baf-fd11-499d-9cab-049f77d32194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:55.559676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a6baf-fd11-499d-9cab-049f77d32194 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:55.598950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 900/1806] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:55.598950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db3554-59cc-41bf-8953-0a915e15f6ab None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.598950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db3554-59cc-41bf-8953-0a915e15f6ab None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.599298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db3554-59cc-41bf-8953-0a915e15f6ab None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.601432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 901/1807] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:49:55.602596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db3554-59cc-41bf-8953-0a915e15f6ab None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:55.611299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 907/1808] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:55.627272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db3554-59cc-41bf-8953-0a915e15f6ab None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:55.633778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:55.634713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.635136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.636533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] PATH_INFO: `/v3/projects/629696e808d8485da620b903ea6cdf89/users/448757d94d1d4aeeb1ef29f08421ebb6/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.640784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10512f3-94d1-4049-9778-1eb571cb9799 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.641076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10512f3-94d1-4049-9778-1eb571cb9799 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.641355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10512f3-94d1-4049-9778-1eb571cb9799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.668624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629696e808d8485da620b903ea6cdf89, user_id=448757d94d1d4aeeb1ef29f08421ebb6, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:55.674349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:55.697278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e10512f3-94d1-4049-9778-1eb571cb9799 None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:55.698647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e10512f3-94d1-4049-9778-1eb571cb9799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:55.718326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 908/1809] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:55.775955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 902/1810] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:55 2022] PUT /identity/v3/projects/629696e808d8485da620b903ea6cdf89/users/448757d94d1d4aeeb1ef29f08421ebb6/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:55.778837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.779126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.779399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.794895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:55.863206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] MFA Rules not processed for user `448757d94d1d4aeeb1ef29f08421ebb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:55.864609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:55.933729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c007-9207-4408-b248-61154b4c3e87 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:55.947769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:55.949327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:55.949327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:55.949327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:55.957059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:56.087083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 909/1811] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:56.088072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:56.089586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:56.158854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:56.161182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:56.217251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 903/1812] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:49:56.218299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:56.377004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3b6db-dd2c-4b92-a5bf-70aae859d77e service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:56.393620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:56.397585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:56.397585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:56.397585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:56.397585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:56.398179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:56.429921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ae62e-91a7-409e-91d1-2183bfe3c953 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:56.436726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:56.451748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:56.452128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:56.452446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:56.472278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:56.492957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:56.494603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:56.516760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 910/1813] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:56.539530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 904/1814] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:49:56 2022] POST /identity/v3/projects => generated 391 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:56.543753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:56.563845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c9efa-2de0-423f-b9a7-97bc64b5f925 service nova] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:56.704911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:56.721590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:56.723710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:56.723710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:56.735552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:56.751405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:56.759333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:56.932689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 911/1815] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:49:56 2022] POST /identity/v3/users => generated 302 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:49:56.936090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:56.965457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33cf5-3ff7-4444-ad1c-d9c6af9df031 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:56.983733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:56.984811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:56.985258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:56.985676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:56.986499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:56.988314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:57.016003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:57.017188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 905/1816] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:49:57.031697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d256a56-b018-437a-88d0-3ed41f9e4b56 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:57.046675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:57.047879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:57.048174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:57.048436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] PATH_INFO: `/v3/projects/343046390d3748b0a5ea136577f0ed8b/users/8301c1fc784c4275b9d3737d77f6d9b0/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:57.107494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343046390d3748b0a5ea136577f0ed8b, user_id=8301c1fc784c4275b9d3737d77f6d9b0, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:57.125746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:57.269461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 912/1817] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:57 2022] PUT /identity/v3/projects/343046390d3748b0a5ea136577f0ed8b/users/8301c1fc784c4275b9d3737d77f6d9b0/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:49:57.274022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:57.289750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c1a1-0204-48ab-84e0-c30a7099774a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:57.401291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ee09-ab0f-4b9a-9e24-0f1f47230847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:57.402183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ee09-ab0f-4b9a-9e24-0f1f47230847 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:57.402706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ee09-ab0f-4b9a-9e24-0f1f47230847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:57.412265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ee09-ab0f-4b9a-9e24-0f1f47230847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:57.414961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ee09-ab0f-4b9a-9e24-0f1f47230847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:57.419966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ee09-ab0f-4b9a-9e24-0f1f47230847 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:57.439316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 906/1818] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:49:57.445056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:57.474834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af3b0-40f9-47c0-9c93-4dc20b6bd945 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:57.511772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:57.511772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:57.512336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:57.512619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] PATH_INFO: `/v3/projects/343046390d3748b0a5ea136577f0ed8b/users/8301c1fc784c4275b9d3737d77f6d9b0/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:57.520405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343046390d3748b0a5ea136577f0ed8b, user_id=8301c1fc784c4275b9d3737d77f6d9b0, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:57.524188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:57.567222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 913/1819] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:49:57 2022] PUT /identity/v3/projects/343046390d3748b0a5ea136577f0ed8b/users/8301c1fc784c4275b9d3737d77f6d9b0/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:49:57.573874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62abb-4c5d-41c2-adbd-912f4e720526 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:57.574302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62abb-4c5d-41c2-adbd-912f4e720526 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:57.574778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62abb-4c5d-41c2-adbd-912f4e720526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:57.673709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-96d62abb-4c5d-41c2-adbd-912f4e720526 None None] MFA Rules not processed for user `8301c1fc784c4275b9d3737d77f6d9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:49:57.682511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-96d62abb-4c5d-41c2-adbd-912f4e720526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:57.923969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:58.014930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 907/1820] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:49:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:49:58.048835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:58.050574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:49:58.167935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2980827-f12c-49ac-aa27-d68988e45497 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:58.174938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:58.175956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:58.176413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:58.176913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:58.189342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:58.191716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:58.220464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 914/1821] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:49:58.311820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d62abb-4c5d-41c2-adbd-912f4e720526 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:58.330137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d62abb-4c5d-41c2-adbd-912f4e720526 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:58.346329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:58.347006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:58.347289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:58.347918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:58.452678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:58.457951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:58.488136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 908/1822] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:49:58.659529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:58.967485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:49:58.973243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56cb3c-dc12-40af-a4a5-3dd903fc5d92 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:49:58.979088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348bdf-757a-4709-ab47-fc8918e55e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:49:58.980666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348bdf-757a-4709-ab47-fc8918e55e4e service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:49:58.981351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348bdf-757a-4709-ab47-fc8918e55e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:49:58.981891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348bdf-757a-4709-ab47-fc8918e55e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:49:59.104684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53348bdf-757a-4709-ab47-fc8918e55e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:49:59.106679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53348bdf-757a-4709-ab47-fc8918e55e4e service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:49:59.121252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 915/1823] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:49:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:00.153740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:01.233513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:02.158247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:03.017758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:03.079789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:05.655166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:06.226373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:06.286483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bb48d-81bb-4544-83fc-0d596d075150 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:06.291322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:06.291990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:06.292273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:06.292553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] PATH_INFO: `/v3/users/448757d94d1d4aeeb1ef29f08421ebb6` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:06.293683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448757d94d1d4aeeb1ef29f08421ebb6)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:06.295632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:06.487904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448757d94d1d4aeeb1ef29f08421ebb6'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:06.489693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448757d94d1d4aeeb1ef29f08421ebb6'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:06.518271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448757d94d1d4aeeb1ef29f08421ebb6'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:06.603039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448757d94d1d4aeeb1ef29f08421ebb6'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:06.603717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448757d94d1d4aeeb1ef29f08421ebb6'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:06.621349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 909/1824] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:06 2022] DELETE /identity/v3/users/448757d94d1d4aeeb1ef29f08421ebb6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:06.628513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:06.629013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:06.629095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:06.642429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:06.648515 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:06.667737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:06.668973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:06.721814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb1394-936d-4999-ab5e-866f485438a6 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:06.727823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:06.733243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:06.733243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:06.733243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] PATH_INFO: `/v3/users/c9b283499bbc4e0c92a56d65844fe8dd` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:06.733243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b283499bbc4e0c92a56d65844fe8dd)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:06.733243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:06.742357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 916/1825] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:06.749217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:06.750783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:06.780704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:06.811598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25423471-0e95-400f-b035-a2a9de34ae85 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:06.815273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:06.816012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:06.816288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:06.816558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:06.825805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:06.827243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:06.838776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 917/1826] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:06.839499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:06.840825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:06.854397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cdf28-aed1-449c-a68e-257e41e6c89f service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:06.859310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:06.859897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:06.860178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:06.860451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] PATH_INFO: `/v3/users/b58fc96c26c14ffc9a862d00ddd92a31` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:06.861642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58fc96c26c14ffc9a862d00ddd92a31)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:06.863896 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:07.044993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b283499bbc4e0c92a56d65844fe8dd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.045738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b283499bbc4e0c92a56d65844fe8dd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.062601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b283499bbc4e0c92a56d65844fe8dd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.186479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b283499bbc4e0c92a56d65844fe8dd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.191486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8af181e3-eec6-4b5b-9508-3d4eb777f33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b283499bbc4e0c92a56d65844fe8dd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.203523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58fc96c26c14ffc9a862d00ddd92a31'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.204194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58fc96c26c14ffc9a862d00ddd92a31'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.207723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 910/1827] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:06 2022] DELETE /identity/v3/users/c9b283499bbc4e0c92a56d65844fe8dd => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:07.209981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:07.215721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:07.215721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:07.223140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58fc96c26c14ffc9a862d00ddd92a31'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.232969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:07.234408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:07.286303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58fc96c26c14ffc9a862d00ddd92a31'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.291032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58fc96c26c14ffc9a862d00ddd92a31'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.300436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 911/1828] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:07.300436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:07.307938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:07.308463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 918/1829] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:06 2022] DELETE /identity/v3/users/b58fc96c26c14ffc9a862d00ddd92a31 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:07.310295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:07.312286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:07.321692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84b6bd-e505-4b35-a9bb-448d52bc113d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:07.376654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d62254-f0b9-4a54-ac94-b53bce681fa8 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:07.380436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351d7f3-1e50-4dba-a810-9001a4de6b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:07.381554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d7f3-1e50-4dba-a810-9001a4de6b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:07.381835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d7f3-1e50-4dba-a810-9001a4de6b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:07.382110 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d7f3-1e50-4dba-a810-9001a4de6b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:07.382947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:07.383852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:07.384267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:07.384565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] PATH_INFO: `/v3/projects/629696e808d8485da620b903ea6cdf89` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:07.385979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629696e808d8485da620b903ea6cdf89)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:07.388172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:07.392431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351d7f3-1e50-4dba-a810-9001a4de6b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:07.393927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351d7f3-1e50-4dba-a810-9001a4de6b18 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:07.404505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 919/1830] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:07.405778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a114-44e2-4c63-9b04-5b7aea4c6359 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:07.406065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a114-44e2-4c63-9b04-5b7aea4c6359 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:07.406337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a114-44e2-4c63-9b04-5b7aea4c6359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:07.426519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c7b6a114-44e2-4c63-9b04-5b7aea4c6359 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:07.427897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c7b6a114-44e2-4c63-9b04-5b7aea4c6359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:07.436026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 920/1831] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:07.446790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6a114-44e2-4c63-9b04-5b7aea4c6359 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:07.456397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6a114-44e2-4c63-9b04-5b7aea4c6359 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:07.461607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:07.462221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:07.462503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:07.462779 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:07.472592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:07.474474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:07.484140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 921/1832] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:07.535643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629696e808d8485da620b903ea6cdf89', 'request_id': 'req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.543274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629696e808d8485da620b903ea6cdf89', 'request_id': 'req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.667288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629696e808d8485da620b903ea6cdf89', 'request_id': 'req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.692191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] The token cache is being invalidate because project 629696e808d8485da620b903ea6cdf89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:07.692554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.695368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:07.698664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 912/1833] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:07 2022] DELETE /identity/v3/projects/629696e808d8485da620b903ea6cdf89 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:07.702367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:07.716471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa2326-ed13-478a-bf5b-5322f4149ed4 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:07.803660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:07.803660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:07.813017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:07.813533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] PATH_INFO: `/v3/users/8301c1fc784c4275b9d3737d77f6d9b0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:07.815163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8301c1fc784c4275b9d3737d77f6d9b0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:07.818636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:08.014988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:08.026334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:08.027910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:08.041767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14bf96-a4aa-4cbe-abcf-f3ab9e705d51 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:08.046829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:08.047575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:08.047822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:08.048101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] PATH_INFO: `/v3/projects/44da2df865684b639bd8f3fc6725a111` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:08.049238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44da2df865684b639bd8f3fc6725a111)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:08.051451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:08.138499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8301c1fc784c4275b9d3737d77f6d9b0'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.139277 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8301c1fc784c4275b9d3737d77f6d9b0'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.153214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8301c1fc784c4275b9d3737d77f6d9b0'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.189481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44da2df865684b639bd8f3fc6725a111', 'request_id': 'req-0b77ef25-7817-4118-a953-c4cab1b4ca13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.196116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44da2df865684b639bd8f3fc6725a111', 'request_id': 'req-0b77ef25-7817-4118-a953-c4cab1b4ca13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.272242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8301c1fc784c4275b9d3737d77f6d9b0'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.273218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8301c1fc784c4275b9d3737d77f6d9b0'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.285979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 922/1834] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:07 2022] DELETE /identity/v3/users/8301c1fc784c4275b9d3737d77f6d9b0 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:08.286844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:08.288490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:08.357244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44da2df865684b639bd8f3fc6725a111', 'request_id': 'req-0b77ef25-7817-4118-a953-c4cab1b4ca13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.375520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] The token cache is being invalidate because project 44da2df865684b639bd8f3fc6725a111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:08.375770 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.376545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:08.378776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 913/1835] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:08 2022] DELETE /identity/v3/projects/44da2df865684b639bd8f3fc6725a111 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:08.384538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:08.387260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995132-fe23-4185-b9d2-0c3b8e10e128 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:08.388933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:08.402592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:08.404120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:08.405774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:08.406266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] PATH_INFO: `/v3/projects/850e4b9bf7e34f29bcd239ba9dc23c2d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:08.408451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850e4b9bf7e34f29bcd239ba9dc23c2d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:08.411863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:08.474720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ef25-7817-4118-a953-c4cab1b4ca13 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:08.479315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:08.479981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:08.480267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:08.480544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] PATH_INFO: `/v3/users/72f7b59d07e94aca8fd87bf3358d6723` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:08.481702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f7b59d07e94aca8fd87bf3358d6723)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:08.483696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:09.221005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850e4b9bf7e34f29bcd239ba9dc23c2d', 'request_id': 'req-8e308764-5e9c-4d52-93a3-5069bf6a9241'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.230157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850e4b9bf7e34f29bcd239ba9dc23c2d', 'request_id': 'req-8e308764-5e9c-4d52-93a3-5069bf6a9241'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.611924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850e4b9bf7e34f29bcd239ba9dc23c2d', 'request_id': 'req-8e308764-5e9c-4d52-93a3-5069bf6a9241'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.649327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] The token cache is being invalidate because project 850e4b9bf7e34f29bcd239ba9dc23c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:09.649640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.650295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.652171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 923/1836] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:08 2022] DELETE /identity/v3/projects/850e4b9bf7e34f29bcd239ba9dc23c2d => generated 0 bytes in 1365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:09.655299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f7b59d07e94aca8fd87bf3358d6723'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.655777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:09.656170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f7b59d07e94aca8fd87bf3358d6723'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.657130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:09.671964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f7b59d07e94aca8fd87bf3358d6723'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.731794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e308764-5e9c-4d52-93a3-5069bf6a9241 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:09.736651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:09.737390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:09.737674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:09.737948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] PATH_INFO: `/v3/projects/343046390d3748b0a5ea136577f0ed8b` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:09.739218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=343046390d3748b0a5ea136577f0ed8b)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:09.741089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f7b59d07e94aca8fd87bf3358d6723'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.741792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f7b59d07e94aca8fd87bf3358d6723'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.742021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:09.761183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 914/1837] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:08 2022] DELETE /identity/v3/users/72f7b59d07e94aca8fd87bf3358d6723 => generated 0 bytes in 1378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:09.762339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:09.764056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:09.877282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343046390d3748b0a5ea136577f0ed8b', 'request_id': 'req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.883663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4bb46-44a3-4270-8eea-d2229bde0d7e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:09.892249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343046390d3748b0a5ea136577f0ed8b', 'request_id': 'req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:09.948998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:09.949647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:09.949935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:09.950213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] PATH_INFO: `/v3/users/b9ed8aa692454fbb937560bf0abd8f0b` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:09.951386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ed8aa692454fbb937560bf0abd8f0b)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:09.953347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:10.068065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343046390d3748b0a5ea136577f0ed8b', 'request_id': 'req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.080349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] The token cache is being invalidate because project 343046390d3748b0a5ea136577f0ed8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:10.080783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.082082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c3ee1530-8d59-4fb6-9d80-7cbe91d7bbcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.089032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 924/1838] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:09 2022] DELETE /identity/v3/projects/343046390d3748b0a5ea136577f0ed8b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:10.090514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19f46-5420-4937-9f4d-81afecff4d9d None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.090862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19f46-5420-4937-9f4d-81afecff4d9d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.091235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19f46-5420-4937-9f4d-81afecff4d9d None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.092808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 925/1839] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:50:10.093684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b60e9-3d12-4e6a-b465-b112b5a86c74 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.093965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b60e9-3d12-4e6a-b465-b112b5a86c74 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.094236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b60e9-3d12-4e6a-b465-b112b5a86c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.115801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ed2b60e9-3d12-4e6a-b465-b112b5a86c74 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:10.116901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ed2b60e9-3d12-4e6a-b465-b112b5a86c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:10.134007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 926/1840] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:10.135470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ec00-5cdb-496e-9a1c-b6770dc798c6 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.135753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ec00-5cdb-496e-9a1c-b6770dc798c6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.136027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ec00-5cdb-496e-9a1c-b6770dc798c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.157039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4834ec00-5cdb-496e-9a1c-b6770dc798c6 None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:10.158305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4834ec00-5cdb-496e-9a1c-b6770dc798c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:10.248992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 927/1841] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:10.251149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.251828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.252262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.257697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ed8aa692454fbb937560bf0abd8f0b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.259357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ed8aa692454fbb937560bf0abd8f0b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.299515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:10.300737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:10.304486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ed8aa692454fbb937560bf0abd8f0b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.315225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 928/1842] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:10.317054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:10.317683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:10.335248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b9f13-8500-4b5c-afac-4705922c2fb0 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:10.343383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:10.344032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.344329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.344599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.352272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:10.372767 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:10.375272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:10.394536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 929/1843] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:10.394536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:10.407554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee900-92a8-4f74-b515-757a6e71512e service nova] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:10.413387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:10.414385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.414504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ed8aa692454fbb937560bf0abd8f0b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.414994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.415290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.416253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ed8aa692454fbb937560bf0abd8f0b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.416550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:10.416550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:10.418112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:10.433304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 915/1844] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:09 2022] DELETE /identity/v3/users/b9ed8aa692454fbb937560bf0abd8f0b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:10.436316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 930/1845] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:10.437564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:10.440640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:10.440961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:10.457060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649c6f5-c7c6-4dec-adfc-3513cfdbaff1 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:10.519817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:10.528496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:10.528751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.529000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.529271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.529907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:10.533018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:10.576660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e507e5e-3266-419f-8028-14c36ffde6f9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:10.585459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:10.586182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.586467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.586757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] PATH_INFO: `/v3/projects/2cd4f0759a19428386c16c4ffe79a7f2` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.588997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd4f0759a19428386c16c4ffe79a7f2)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:10.591808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:10.666637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 931/1846] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:10 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:10.670642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:10.770648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd4f0759a19428386c16c4ffe79a7f2', 'request_id': 'req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.776311 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eee481-f188-4a54-bc09-52c3d90fe800 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:10.784953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd4f0759a19428386c16c4ffe79a7f2', 'request_id': 'req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.878137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd4f0759a19428386c16c4ffe79a7f2', 'request_id': 'req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.887739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:10.889241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.889620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.889992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.890735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:10.893682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:10.896802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] The token cache is being invalidate because project 2cd4f0759a19428386c16c4ffe79a7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:10.897124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.899944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-61e6911f-10f9-4a6c-81c4-254c4c5dc68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:10.902356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 916/1847] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:10 2022] DELETE /identity/v3/projects/2cd4f0759a19428386c16c4ffe79a7f2 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:10.914287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57289a4-a089-4e14-b3c9-d50d39d77725 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.914576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57289a4-a089-4e14-b3c9-d50d39d77725 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.914848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57289a4-a089-4e14-b3c9-d50d39d77725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.951849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a57289a4-a089-4e14-b3c9-d50d39d77725 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:10.953533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a57289a4-a089-4e14-b3c9-d50d39d77725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:10.965769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 917/1848] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:10.974101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbac88-3d0b-4fb8-a12d-a876df7a8058 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:10.974393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbac88-3d0b-4fb8-a12d-a876df7a8058 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:10.975211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbac88-3d0b-4fb8-a12d-a876df7a8058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:10.987171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 932/1849] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:10 2022] POST /identity/v3/users => generated 292 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:10.992015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:10.993791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.022568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31a8fc-f5d9-435b-a4eb-d23e0fc3eb52 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.030078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f3cbac88-3d0b-4fb8-a12d-a876df7a8058 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:11.031286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f3cbac88-3d0b-4fb8-a12d-a876df7a8058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.034560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.036240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.037407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.038373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.040960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 918/1850] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:11.041649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.043296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.044635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbac88-3d0b-4fb8-a12d-a876df7a8058 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.061473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 933/1851] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:11.065286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.070545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbac88-3d0b-4fb8-a12d-a876df7a8058 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.077996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.084880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.084880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.084880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.084880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:11.084880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.084880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.092608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95ef30-6cba-48c9-99da-ad988073b9e2 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.108140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.108892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.109234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.109601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.109731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 919/1852] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:50:11.111312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.113020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.118043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.137630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa809e-2023-45ea-82c5-3e733e60ddef admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.141855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 934/1853] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:11.145293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.145293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.145293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.145293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.145607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.147722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.148719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.160245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9b6f-f39c-4e88-96c4-29b07b4eda39 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.167488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.168242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.170153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.170153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] PATH_INFO: `/v3/projects/d6ba592676584a0f85cc620fbadccebc/users/57b3953d16d34113aee5780f59b5ef67/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.186450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ba592676584a0f85cc620fbadccebc, user_id=57b3953d16d34113aee5780f59b5ef67, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.189368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.228427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 920/1854] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:11 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:11.232472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.278734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 935/1855] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:11 2022] PUT /identity/v3/projects/d6ba592676584a0f85cc620fbadccebc/users/57b3953d16d34113aee5780f59b5ef67/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:11.279968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.281707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.309351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816e3f-5f03-40ab-9c62-534d4f2460dd admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.339295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:11.412806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070665-b9dc-4d84-ac5a-b3b9d66e4847 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.418802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.419591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.420285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.420828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] PATH_INFO: `/v3/projects/4582cebd5bf2484db4928694758d3d60` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.422820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4582cebd5bf2484db4928694758d3d60)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.425072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.428909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded5520-052f-42d9-8415-0a667e3c56e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.429710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5520-052f-42d9-8415-0a667e3c56e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.430053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5520-052f-42d9-8415-0a667e3c56e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.430325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5520-052f-42d9-8415-0a667e3c56e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.431243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded5520-052f-42d9-8415-0a667e3c56e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.433354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded5520-052f-42d9-8415-0a667e3c56e7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.585680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 921/1856] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:11 2022] POST /identity/v3/users => generated 289 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:11.585680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fc43f-b652-49c3-a180-851d721f5636 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.585932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fc43f-b652-49c3-a180-851d721f5636 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.586026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fc43f-b652-49c3-a180-851d721f5636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.615715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4582cebd5bf2484db4928694758d3d60', 'request_id': 'req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:11.621401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-627fc43f-b652-49c3-a180-851d721f5636 None None] MFA Rules not processed for user `57b3953d16d34113aee5780f59b5ef67`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:11.622623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-627fc43f-b652-49c3-a180-851d721f5636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.623150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4582cebd5bf2484db4928694758d3d60', 'request_id': 'req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:11.690082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 922/1857] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:11.691054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fc43f-b652-49c3-a180-851d721f5636 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.709441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4582cebd5bf2484db4928694758d3d60', 'request_id': 'req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:11.732308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] The token cache is being invalidate because project 4582cebd5bf2484db4928694758d3d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:11.732971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:11.734530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:11.736639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 936/1858] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:11 2022] DELETE /identity/v3/projects/4582cebd5bf2484db4928694758d3d60 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:11.741959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.743384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.774168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fc43f-b652-49c3-a180-851d721f5636 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.779353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb0913-e3e1-4c60-8517-dd286d96df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.780026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0913-e3e1-4c60-8517-dd286d96df6c admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.780283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0913-e3e1-4c60-8517-dd286d96df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.780554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb0913-e3e1-4c60-8517-dd286d96df6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.781199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb0913-e3e1-4c60-8517-dd286d96df6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.782800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb0913-e3e1-4c60-8517-dd286d96df6c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.798298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 923/1859] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:11.801089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.801089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.801089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.821017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:11.822224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.830631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 924/1860] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:11.831499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.832976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.843211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e691bab-f2de-4af4-adb1-cd9f1e87e7bc admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.857209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750e7a-f19f-4446-85cf-1e72c676aace None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.857454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.857454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.857454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.857454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.857716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.857799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7510f63-b8bc-4fed-8189-d0740ece0407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.857799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510f63-b8bc-4fed-8189-d0740ece0407 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.857934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.858002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510f63-b8bc-4fed-8189-d0740ece0407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.858002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510f63-b8bc-4fed-8189-d0740ece0407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.858002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7510f63-b8bc-4fed-8189-d0740ece0407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.858002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7510f63-b8bc-4fed-8189-d0740ece0407 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.871333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 925/1861] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:11.871333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815ecca-a38c-4c77-a168-0f9a2fdcf16e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.871333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815ecca-a38c-4c77-a168-0f9a2fdcf16e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.871333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815ecca-a38c-4c77-a168-0f9a2fdcf16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.889308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6815ecca-a38c-4c77-a168-0f9a2fdcf16e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:11.890412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6815ecca-a38c-4c77-a168-0f9a2fdcf16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:11.898537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 926/1862] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:11.899354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815ecca-a38c-4c77-a168-0f9a2fdcf16e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:11.908811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815ecca-a38c-4c77-a168-0f9a2fdcf16e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:11.913940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:11.915992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:11.915992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:11.915992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] PATH_INFO: `/v3/projects/d1e224a8d9f34a6a9e7eddff1b736fd5/users/600e7911a8214c1387b4173021d6de4a/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:11.930180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e224a8d9f34a6a9e7eddff1b736fd5, user_id=600e7911a8214c1387b4173021d6de4a, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:11.933037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:11.996855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 937/1863] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:11 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:11.996855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.066209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7a0e2-f53a-43d6-9b6f-cb7a29d55fb0 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.071000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.071640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.073353 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.073659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.074331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:12.074641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.076340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.088925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 938/1864] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:12.089597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.090965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 927/1865] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:11 2022] PUT /identity/v3/projects/d1e224a8d9f34a6a9e7eddff1b736fd5/users/600e7911a8214c1387b4173021d6de4a/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:12.094039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.101338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852fa3b-2453-4af7-a690-4d9b86939c26 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.172063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63fa5-e112-49d1-8ddb-d3f2d4ff6acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.172679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63fa5-e112-49d1-8ddb-d3f2d4ff6acd admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.175090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63fa5-e112-49d1-8ddb-d3f2d4ff6acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.175090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63fa5-e112-49d1-8ddb-d3f2d4ff6acd admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.175090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b63fa5-e112-49d1-8ddb-d3f2d4ff6acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.177254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b63fa5-e112-49d1-8ddb-d3f2d4ff6acd admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.179605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acec5-f8a4-462f-bebc-25d516183df5 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.195559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.196329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.196749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.197034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.197683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.199631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.267363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 939/1866] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:12 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:12.269298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93562b43-7ed4-4290-9dea-0c495e1bbf07 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.269888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93562b43-7ed4-4290-9dea-0c495e1bbf07 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.270666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93562b43-7ed4-4290-9dea-0c495e1bbf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.304183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 928/1867] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:12 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:12.305072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.306057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-93562b43-7ed4-4290-9dea-0c495e1bbf07 None None] MFA Rules not processed for user `600e7911a8214c1387b4173021d6de4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:12.307398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-93562b43-7ed4-4290-9dea-0c495e1bbf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:12.385406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafc145-cbeb-4270-8be8-39efef50e920 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.391607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.392159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.392453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.392732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.393391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.396455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.409267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 929/1868] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:12.410658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.423445 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e617ea-6111-4b56-b547-be107af72b5f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.434179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.434957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.435490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.435802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.436642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.438490 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 940/1869] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:12.439332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93562b43-7ed4-4290-9dea-0c495e1bbf07 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.442400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.449912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93562b43-7ed4-4290-9dea-0c495e1bbf07 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.454881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.464097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.464097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.464097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.464097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.464097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.468722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 941/1870] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:12.469496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.479665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fbbe-19c8-4662-8b59-976d9d9e5fb6 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.485063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.485637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.485919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.486192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.486819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.488762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.641562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:12.649610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 930/1871] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:12 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:12.649610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.649852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 942/1872] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:12 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:12.649852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.657349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813ba69-a691-41e6-b490-3f107b7827e5 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.725214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.725905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.726220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.726540 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] PATH_INFO: `/v3/projects/965c1b47bf014b74942b30e1357adb09/users/0644cb3325194577be724aade9db60d2/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.746678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965c1b47bf014b74942b30e1357adb09, user_id=0644cb3325194577be724aade9db60d2, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.749247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bee7d-998f-42b1-8489-782c994ab952 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.749390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.754751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.755798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.755798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.756069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.756863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.758482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.770409 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 943/1873] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:12.771871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.778848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:12.784340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59277a4-dd19-4ab4-a74f-9bf373299ea4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.790545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7060e7-d185-4abc-9de7-830751047f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.791971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7060e7-d185-4abc-9de7-830751047f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.792177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7060e7-d185-4abc-9de7-830751047f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.792769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7060e7-d185-4abc-9de7-830751047f64 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.793422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7060e7-d185-4abc-9de7-830751047f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.795393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7060e7-d185-4abc-9de7-830751047f64 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.852682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 931/1874] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:12 2022] PUT /identity/v3/projects/965c1b47bf014b74942b30e1357adb09/users/0644cb3325194577be724aade9db60d2/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:12.853519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.890791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 944/1875] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:12 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:12.891986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fcb00-0fea-4548-94bd-90729fe5a9d7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.892273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fcb00-0fea-4548-94bd-90729fe5a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.892552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fcb00-0fea-4548-94bd-90729fe5a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.924953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d1ba-1e79-4e5e-ad1f-001af531e1b9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.930487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.931184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.931491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.931771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.932084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-099fcb00-0fea-4548-94bd-90729fe5a9d7 None None] MFA Rules not processed for user `0644cb3325194577be724aade9db60d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:12.932417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.933802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-099fcb00-0fea-4548-94bd-90729fe5a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:12.934104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.947202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 932/1876] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:12.948406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.960171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bac1dc-c3e8-44e9-b1b4-21dae748fa6d admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.965104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.965828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.966109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:12.966383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:12.967074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:12.968695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:12.979632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 933/1877] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:12.980713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:12.992023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1d005-5439-4dc9-b2ef-9d1fded624ad admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:12.996852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:12.997554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:12.997833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.001694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] PATH_INFO: `/v3/projects/70a5e188d1d2465faa52500b35fc6449/users/2910b2a75015410796031e4d6bae9aaf/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.015068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a5e188d1d2465faa52500b35fc6449, user_id=2910b2a75015410796031e4d6bae9aaf, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.015631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 945/1878] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:13.016707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fcb00-0fea-4548-94bd-90729fe5a9d7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.018116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.027845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fcb00-0fea-4548-94bd-90729fe5a9d7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.032329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.032931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.033207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.036289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.036289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.036289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.046010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 946/1879] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:13.046984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.057894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3346f-f2c3-40e9-a679-326489345cc3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.062642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9e35f-1ccc-41f6-a371-8aee378b1be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.063877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9e35f-1ccc-41f6-a371-8aee378b1be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.064162 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9e35f-1ccc-41f6-a371-8aee378b1be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.064502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9e35f-1ccc-41f6-a371-8aee378b1be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.065136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9e35f-1ccc-41f6-a371-8aee378b1be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.067160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9e35f-1ccc-41f6-a371-8aee378b1be8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.105788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 934/1880] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:12 2022] PUT /identity/v3/projects/70a5e188d1d2465faa52500b35fc6449/users/2910b2a75015410796031e4d6bae9aaf/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:13.106598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.164053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 947/1881] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:13.166816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a749a2-ddd2-4e27-ac3f-c463199ab6f9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.167354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a749a2-ddd2-4e27-ac3f-c463199ab6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.168092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a749a2-ddd2-4e27-ac3f-c463199ab6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.188779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8542-c26d-4bb4-9a23-e7a4c6405f1d admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.210141 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f9a749a2-ddd2-4e27-ac3f-c463199ab6f9 None None] MFA Rules not processed for user `2910b2a75015410796031e4d6bae9aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:13.211776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f9a749a2-ddd2-4e27-ac3f-c463199ab6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:13.252107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.252775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.253055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.253329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] PATH_INFO: `/v3/projects/3c2b45f73a4f4680938dd2fa638d3bfc/users/3ce79cea9ce643ed9583200b0dc20644/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.272546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2b45f73a4f4680938dd2fa638d3bfc, user_id=3ce79cea9ce643ed9583200b0dc20644, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.275285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.283789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 948/1882] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:13.284731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a749a2-ddd2-4e27-ac3f-c463199ab6f9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.301738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a749a2-ddd2-4e27-ac3f-c463199ab6f9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.307385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005cf2f-5e2b-4daa-8680-8a03eda850e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.308098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005cf2f-5e2b-4daa-8680-8a03eda850e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.308375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005cf2f-5e2b-4daa-8680-8a03eda850e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.308709 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005cf2f-5e2b-4daa-8680-8a03eda850e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.309389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005cf2f-5e2b-4daa-8680-8a03eda850e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.311305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005cf2f-5e2b-4daa-8680-8a03eda850e0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.386714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 935/1883] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:13 2022] PUT /identity/v3/projects/3c2b45f73a4f4680938dd2fa638d3bfc/users/3ce79cea9ce643ed9583200b0dc20644/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:13.387696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.417182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 949/1884] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:13.418323 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be749-ea40-46de-a50d-4abbcf7602ac None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.423708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be749-ea40-46de-a50d-4abbcf7602ac None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.423708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4be749-ea40-46de-a50d-4abbcf7602ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.449935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-7a4be749-ea40-46de-a50d-4abbcf7602ac None None] MFA Rules not processed for user `3ce79cea9ce643ed9583200b0dc20644`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:13.451232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7a4be749-ea40-46de-a50d-4abbcf7602ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:13.460857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172df3f-7a91-4112-a7ae-7957e2999029 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.465781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.466532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.466833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.467095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.467766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.469662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.520207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 950/1885] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:13.521116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4be749-ea40-46de-a50d-4abbcf7602ac None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.532917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4be749-ea40-46de-a50d-4abbcf7602ac None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.538658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.539247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.539570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.539852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.540495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.542096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.552070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 951/1886] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:13.553441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.563469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705558-3286-435f-a177-c719cc867056 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.569248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.569870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.570154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.570429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.571321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.573116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.625145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 936/1887] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:13.625145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.698462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 952/1888] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:13.698462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.710432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d14d9-2b73-4a98-8b9b-db0b8a4e1350 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.800451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.801133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.801417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.801749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] PATH_INFO: `/v3/projects/6b293f6382f64e8f9cd21a93e5812c00/users/3b0ca95d25754657ad2ec1e45fa448e2/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.815005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72015f2-0eb3-4651-8da0-9725779e1737 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:13.819069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b293f6382f64e8f9cd21a93e5812c00, user_id=3b0ca95d25754657ad2ec1e45fa448e2, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.820608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.821166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:13.822035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:13.822309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:13.822586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:13.823476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:13.826019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:13.899993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 937/1889] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:13 2022] PUT /identity/v3/projects/6b293f6382f64e8f9cd21a93e5812c00/users/3b0ca95d25754657ad2ec1e45fa448e2/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:13.903658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.942402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 953/1890] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:13.943701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:13.967131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dab0a1-b9ad-4992-b3ec-03e6a0acb750 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.011172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7966e-3d9f-45f9-bf05-8aca07be5961 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.019134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.020433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.020727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.021010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.022967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.024957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.101495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.102262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.102621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.103377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.103724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.105551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.122473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 954/1891] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:14.123575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.137099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b069f4-c310-4ec4-9a85-3cb782f87e5d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.149742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.153141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 938/1892] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:13 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:14.153290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.153290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.153455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.153531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.154540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.156239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.168243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916342-d659-4f57-9590-e3536c5b6de3 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.174655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.175405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.175742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.176200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] PATH_INFO: `/v3/projects/6b293f6382f64e8f9cd21a93e5812c00/users/3b0ca95d25754657ad2ec1e45fa448e2/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.180338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b293f6382f64e8f9cd21a93e5812c00, user_id=3b0ca95d25754657ad2ec1e45fa448e2, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.181462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 955/1893] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:14.183288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.187257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.202255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 939/1894] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:14 2022] PUT /identity/v3/projects/6b293f6382f64e8f9cd21a93e5812c00/users/3b0ca95d25754657ad2ec1e45fa448e2/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:14.203305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.210076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf07e9-4345-489c-a8ef-fceef4917cee admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.306040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160e90b-9aba-4534-b467-5b8de96b9dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.306519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e90b-9aba-4534-b467-5b8de96b9dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.306821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e90b-9aba-4534-b467-5b8de96b9dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.307688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160e90b-9aba-4534-b467-5b8de96b9dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.308505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e90b-9aba-4534-b467-5b8de96b9dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.314112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160e90b-9aba-4534-b467-5b8de96b9dc0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.328622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 956/1895] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:14.330264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0dc3e-a418-4497-a301-051377630e13 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.330615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0dc3e-a418-4497-a301-051377630e13 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.331210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0dc3e-a418-4497-a301-051377630e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.352038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc15d4-8b0b-46b6-a0b3-6883b652f389 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.364250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.365462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.367470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.367799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] PATH_INFO: `/v3/projects/e96fc2ae93694d3685ad56e1d83678d1/users/b0508e3b21404fca88e86dce02d2583a/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.396914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b3c0dc3e-a418-4497-a301-051377630e13 None None] MFA Rules not processed for user `3b0ca95d25754657ad2ec1e45fa448e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:14.397127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96fc2ae93694d3685ad56e1d83678d1, user_id=b0508e3b21404fca88e86dce02d2583a, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.398665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b3c0dc3e-a418-4497-a301-051377630e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:14.402679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.478976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 940/1896] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:14 2022] PUT /identity/v3/projects/e96fc2ae93694d3685ad56e1d83678d1/users/b0508e3b21404fca88e86dce02d2583a/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:14.480131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.511658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 957/1897] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:14.511658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0dc3e-a418-4497-a301-051377630e13 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.523085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0dc3e-a418-4497-a301-051377630e13 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.569826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36410a00-8099-4f9c-823e-b52e31732cac admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.576211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.576680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.576968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.577314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] PATH_INFO: `/v3/projects/729a30d8d61e44eb86c90b2f093f9c0c/users/f287d4f3905849fa9eb591aaa9d6d7f4/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.602782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=729a30d8d61e44eb86c90b2f093f9c0c, user_id=f287d4f3905849fa9eb591aaa9d6d7f4, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.607002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.636559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.637190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.637472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.637753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.638417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.640166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.649393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:14.664707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 958/1898] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:14.669077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.676656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:14.695501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 941/1899] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:14 2022] PUT /identity/v3/projects/729a30d8d61e44eb86c90b2f093f9c0c/users/f287d4f3905849fa9eb591aaa9d6d7f4/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:14.696572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.743496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bbaba-d14d-4ecb-9468-e9cb04a310b7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.794611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5f14d-d137-40ee-9b91-7d71ef817bbd admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.807005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.808222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.808829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.809279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] PATH_INFO: `/v3/projects/e96fc2ae93694d3685ad56e1d83678d1/users/b0508e3b21404fca88e86dce02d2583a/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.814712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96fc2ae93694d3685ad56e1d83678d1, user_id=b0508e3b21404fca88e86dce02d2583a, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.820283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.842962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 942/1900] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:14 2022] PUT /identity/v3/projects/e96fc2ae93694d3685ad56e1d83678d1/users/b0508e3b21404fca88e86dce02d2583a/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:14.843970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.864443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.865223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.865657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.865766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.868105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:14.958265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354def8-021f-4c0e-9ce2-7447e1d66a1e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:14.967390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.970525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.973234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c04a-89f2-4918-a0ab-2e29c77f26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:14.974396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c04a-89f2-4918-a0ab-2e29c77f26a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.974396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c04a-89f2-4918-a0ab-2e29c77f26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.974930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c04a-89f2-4918-a0ab-2e29c77f26a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:14.977680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917c04a-89f2-4918-a0ab-2e29c77f26a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:14.979494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 959/1901] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:14.979727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917c04a-89f2-4918-a0ab-2e29c77f26a3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:14.981921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:14.983344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:14.992602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 943/1902] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:14.994386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22597c1-962a-42fe-8b7d-6b3c6b702af1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:14.995034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22597c1-962a-42fe-8b7d-6b3c6b702af1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:14.995344 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22597c1-962a-42fe-8b7d-6b3c6b702af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.004701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078751-fa9c-47fa-8d38-b8f2d15afdff service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:15.014637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:15.016173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.016173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.016354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] PATH_INFO: `/v3/users/11d684f8b3cb4cbf9cf0675f9dcbc973` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.019224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d684f8b3cb4cbf9cf0675f9dcbc973)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:15.021998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:15.038226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d22597c1-962a-42fe-8b7d-6b3c6b702af1 None None] MFA Rules not processed for user `b0508e3b21404fca88e86dce02d2583a`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:15.039880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d22597c1-962a-42fe-8b7d-6b3c6b702af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:15.194013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 944/1903] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:15.194013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22597c1-962a-42fe-8b7d-6b3c6b702af1 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:15.208513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22597c1-962a-42fe-8b7d-6b3c6b702af1 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:15.224032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:15.228381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.228381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.228381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] PATH_INFO: `/v3/projects/729a30d8d61e44eb86c90b2f093f9c0c/users/f287d4f3905849fa9eb591aaa9d6d7f4/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.229159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=729a30d8d61e44eb86c90b2f093f9c0c, user_id=f287d4f3905849fa9eb591aaa9d6d7f4, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:15.232054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:15.237548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d684f8b3cb4cbf9cf0675f9dcbc973'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:15.238217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d684f8b3cb4cbf9cf0675f9dcbc973'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:15.247533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 945/1904] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:15 2022] PUT /identity/v3/projects/729a30d8d61e44eb86c90b2f093f9c0c/users/f287d4f3905849fa9eb591aaa9d6d7f4/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:15.248435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:15.250107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:15.260171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d684f8b3cb4cbf9cf0675f9dcbc973'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:15.313725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a1c0d-28ac-40d4-9850-b8eb2ab38c5e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:15.319103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17d03-c17b-4553-8c04-53fbc0d80c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:15.319844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17d03-c17b-4553-8c04-53fbc0d80c96 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.320547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17d03-c17b-4553-8c04-53fbc0d80c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.320547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17d03-c17b-4553-8c04-53fbc0d80c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.322502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-93b17d03-c17b-4553-8c04-53fbc0d80c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:15.411061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17d03-c17b-4553-8c04-53fbc0d80c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:15.413080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17d03-c17b-4553-8c04-53fbc0d80c96 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:15.425681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 946/1905] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:15.426351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d684f8b3cb4cbf9cf0675f9dcbc973'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:15.427327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4dc597c3-dbf8-4234-9f57-3640f343552e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d684f8b3cb4cbf9cf0675f9dcbc973'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:15.428570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.428919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.436711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.450147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 960/1906] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:14 2022] DELETE /identity/v3/users/11d684f8b3cb4cbf9cf0675f9dcbc973 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:15.452757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.453918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.454265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.469691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] MFA Rules not processed for user `f287d4f3905849fa9eb591aaa9d6d7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:15.479853 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:15.488161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:15.489390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:15.571590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 947/1907] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:15.572794 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:15.576014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 961/1908] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:15.579859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:15.582223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:15.585291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:15.651637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81735bf6-4ba0-45e1-bc84-2e8522f10738 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:15.664908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:15.665114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:15.670053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.670053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.670053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] PATH_INFO: `/v3/users/2910b2a75015410796031e4d6bae9aaf` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.670053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2910b2a75015410796031e4d6bae9aaf)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:15.670820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:15.708990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3322fd-50f9-477d-af70-f3936aa520f7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:15.714028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:15.714852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.715134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.715544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.737005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:15.738999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:15.751473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 962/1909] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:15.753055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:15.848908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0a2a3-ad33-493e-ba06-b61a8610259c service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:15.855770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:15.856796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:15.857660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:15.857660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:15.870176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:15.875173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:15.889644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 963/1910] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:15.915158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2910b2a75015410796031e4d6bae9aaf'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:15.915581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2910b2a75015410796031e4d6bae9aaf'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:15.944881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2910b2a75015410796031e4d6bae9aaf'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:16.019849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:16.022698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:16.026210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2910b2a75015410796031e4d6bae9aaf'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:16.029967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97a4f602-f0b5-4c4d-800f-00e959013723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2910b2a75015410796031e4d6bae9aaf'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:16.049264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e029ee-bdb8-46f4-acd0-66114398f4e3 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:16.053013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 948/1911] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:15 2022] DELETE /identity/v3/users/2910b2a75015410796031e4d6bae9aaf => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:16.063303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:16.063864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:16.064444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:16.118044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:16.122104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:16.166102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:16.168478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:16.172364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:16.172976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:16.175137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:16.230745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 949/1912] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:16.258337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:16.260003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:16.270030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 964/1913] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:16.291697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:16.294073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:16.367450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb6811-e49d-4a40-95c8-8bdda96aac30 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:16.372895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:16.374277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:16.374277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:16.374569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:16.387381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:16.389252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:16.403082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 950/1914] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:16.738145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:16.740339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:16.756951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f9dd7-9b73-4921-a1f8-5a54bb6d2b63 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:16.763369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:16.764037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:16.764357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:16.764636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] PATH_INFO: `/v3/projects/25dbbda9c9fc46789bd6b1c846cbae9c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:16.765869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25dbbda9c9fc46789bd6b1c846cbae9c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:16.768062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:16.930424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25dbbda9c9fc46789bd6b1c846cbae9c', 'request_id': 'req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:16.938390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25dbbda9c9fc46789bd6b1c846cbae9c', 'request_id': 'req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.042610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25dbbda9c9fc46789bd6b1c846cbae9c', 'request_id': 'req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.057429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] The token cache is being invalidate because project 25dbbda9c9fc46789bd6b1c846cbae9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:17.057733 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.058425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.059979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 965/1915] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:16 2022] DELETE /identity/v3/projects/25dbbda9c9fc46789bd6b1c846cbae9c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:17.063982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:17.079094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:17.081777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f85fd-f390-4ac0-856a-a1bf49bb7e5d service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:17.081884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:17.153668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:17.154433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:17.154788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:17.155378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] PATH_INFO: `/v3/users/4df5fe4ab8e844eb94f06803f38fecaa` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:17.156850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df5fe4ab8e844eb94f06803f38fecaa)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:17.158833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:17.180868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4e76-a41e-4a41-80da-0fc0105e21d1 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:17.185851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:17.186745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:17.187146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:17.187565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] PATH_INFO: `/v3/projects/70a5e188d1d2465faa52500b35fc6449` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:17.188953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a5e188d1d2465faa52500b35fc6449)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:17.190987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:17.388388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df5fe4ab8e844eb94f06803f38fecaa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.389076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df5fe4ab8e844eb94f06803f38fecaa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.393587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a5e188d1d2465faa52500b35fc6449', 'request_id': 'req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.400760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a5e188d1d2465faa52500b35fc6449', 'request_id': 'req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.402473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df5fe4ab8e844eb94f06803f38fecaa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.408539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:17.505578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a5e188d1d2465faa52500b35fc6449', 'request_id': 'req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.516770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] The token cache is being invalidate because project 70a5e188d1d2465faa52500b35fc6449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:17.517045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.517689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.519194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 966/1916] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:17 2022] DELETE /identity/v3/projects/70a5e188d1d2465faa52500b35fc6449 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:17.519993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:17.521908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:17.576900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4dcdd-972b-46cb-ad94-0b6ab5474018 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:17.580515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:17.581112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:17.581417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:17.581688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:17.583375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:17.608349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df5fe4ab8e844eb94f06803f38fecaa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.609079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df5fe4ab8e844eb94f06803f38fecaa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:17.628472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 951/1917] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:17 2022] DELETE /identity/v3/users/4df5fe4ab8e844eb94f06803f38fecaa => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:17.628472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:17.630072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:17.645030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:17.647642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:17.657929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 967/1918] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:17.712968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d6485-6aa3-4a06-9f12-80767de8aebb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:17.718897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:17.719925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:17.720423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:17.720992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] PATH_INFO: `/v3/users/b0508e3b21404fca88e86dce02d2583a` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:17.724323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0508e3b21404fca88e86dce02d2583a)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:17.726751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:18.042848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0508e3b21404fca88e86dce02d2583a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.043870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0508e3b21404fca88e86dce02d2583a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.064503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0508e3b21404fca88e86dce02d2583a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.225601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0508e3b21404fca88e86dce02d2583a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.226240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0508e3b21404fca88e86dce02d2583a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.239553 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 952/1919] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:17 2022] DELETE /identity/v3/users/b0508e3b21404fca88e86dce02d2583a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:18.293238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:18.294818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:18.346298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:18.414484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f8bed-501b-4eb1-a8e7-2aa2219ab398 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:18.483581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:18.483581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:18.483581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:18.483581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] PATH_INFO: `/v3/projects/247c5ccc46e64f15b1650b43838fcd76` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:18.485408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247c5ccc46e64f15b1650b43838fcd76)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:18.495233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:18.644093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247c5ccc46e64f15b1650b43838fcd76', 'request_id': 'req-c1b508e3-a806-4988-9a19-beb3ad55de89'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.652168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247c5ccc46e64f15b1650b43838fcd76', 'request_id': 'req-c1b508e3-a806-4988-9a19-beb3ad55de89'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.731676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:18.733211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:18.745716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247c5ccc46e64f15b1650b43838fcd76', 'request_id': 'req-c1b508e3-a806-4988-9a19-beb3ad55de89'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.747947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975e7f-2eb1-4e89-9695-118f80aa34e0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:18.760506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] The token cache is being invalidate because project 247c5ccc46e64f15b1650b43838fcd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:18.761155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.762657 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1b508e3-a806-4988-9a19-beb3ad55de89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:18.767714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 968/1920] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:18 2022] DELETE /identity/v3/projects/247c5ccc46e64f15b1650b43838fcd76 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:18.769834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f536-6f8e-4f46-8bc6-13ddaf3e1152 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:18.770295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f536-6f8e-4f46-8bc6-13ddaf3e1152 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:18.770818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f536-6f8e-4f46-8bc6-13ddaf3e1152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:18.793611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a625f536-6f8e-4f46-8bc6-13ddaf3e1152 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:18.795011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a625f536-6f8e-4f46-8bc6-13ddaf3e1152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:18.835042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:18.835749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:18.836030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:18.836305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] PATH_INFO: `/v3/projects/e96fc2ae93694d3685ad56e1d83678d1` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:18.837641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96fc2ae93694d3685ad56e1d83678d1)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:18.839361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:18.869365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 969/1921] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:18.877252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eec5f-8dce-4ae0-aa18-f239f0af748d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:18.877578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eec5f-8dce-4ae0-aa18-f239f0af748d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:18.877918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eec5f-8dce-4ae0-aa18-f239f0af748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:18.903280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-952eec5f-8dce-4ae0-aa18-f239f0af748d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:18.905065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-952eec5f-8dce-4ae0-aa18-f239f0af748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:18.917093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 970/1922] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:18.924228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eec5f-8dce-4ae0-aa18-f239f0af748d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:18.936510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eec5f-8dce-4ae0-aa18-f239f0af748d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:18.950598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:18.954614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:18.954614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:18.954614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:18.954614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:18.954614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:18.954614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:18.970367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 971/1923] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:50:18.974017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:18.987321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a64331-4411-4bb3-b21e-d494a380d3b4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:18.996316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96fc2ae93694d3685ad56e1d83678d1', 'request_id': 'req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:19.003868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96fc2ae93694d3685ad56e1d83678d1', 'request_id': 'req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:19.071552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.072352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.072605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.072944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.073723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.075670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.117253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96fc2ae93694d3685ad56e1d83678d1', 'request_id': 'req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:19.129095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] The token cache is being invalidate because project e96fc2ae93694d3685ad56e1d83678d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:19.129382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:19.130023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-998fbd3a-dadc-45d7-8127-b7ae93d7e6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:19.132240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 953/1924] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:18 2022] DELETE /identity/v3/projects/e96fc2ae93694d3685ad56e1d83678d1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:19.136849 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ecc5-0505-4611-b98d-009396dae1e1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.137132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ecc5-0505-4611-b98d-009396dae1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.137405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ecc5-0505-4611-b98d-009396dae1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.156882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a0e3ecc5-0505-4611-b98d-009396dae1e1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:19.158139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a0e3ecc5-0505-4611-b98d-009396dae1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:19.167294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 954/1925] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:19.175834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745860e-d56c-4965-b468-1faa205a20f7 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.176123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745860e-d56c-4965-b468-1faa205a20f7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.176404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745860e-d56c-4965-b468-1faa205a20f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.196237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a745860e-d56c-4965-b468-1faa205a20f7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:19.198944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a745860e-d56c-4965-b468-1faa205a20f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:19.206693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 972/1926] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:18 2022] POST /identity/v3/projects => generated 365 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:19.211058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.214204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 955/1927] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:19.217495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:19.218343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745860e-d56c-4965-b468-1faa205a20f7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.232329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745860e-d56c-4965-b468-1faa205a20f7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.312013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.312743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.313024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.313297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.314071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:19.314371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.316003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.325645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521b25-ed6e-41b6-b633-5968d0395a30 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.330624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b523b-d009-43f6-970f-488814de983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.332807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b523b-d009-43f6-970f-488814de983b admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.332807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b523b-d009-43f6-970f-488814de983b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.332807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b523b-d009-43f6-970f-488814de983b admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.332807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b523b-d009-43f6-970f-488814de983b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.333416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 956/1928] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:50:19.336066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b523b-d009-43f6-970f-488814de983b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.337937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.348517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2b65-1486-4d94-a251-73d354881682 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.354004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.354633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.354914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.355224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.355913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.357909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.450170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 973/1929] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:19 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:19.454316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b523b-d009-43f6-970f-488814de983b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.472030 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b523b-d009-43f6-970f-488814de983b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.478919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.479716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.480000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.480268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.480913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.482505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.493730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 974/1930] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:19.497945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.512901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735895-979c-415d-999b-2e6394f1038d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.518164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.518768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.519042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.519377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.520033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.522391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.522614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 957/1931] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:19 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:19.538239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.540838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 975/1932] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:19.545136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.557672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b041-3b61-40cc-afe9-08b90a626bb2 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.655049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6316d9b-754f-4aa4-94c2-24ad92960a30 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.657291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.658343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.659135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.660559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] PATH_INFO: `/v3/projects/0f0eb86b8ccf47379650595ac5e6ac5e/users/acadb27478ef4e9b963aae20067a5a28/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.660698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.661305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.661694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.663414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.663866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.666004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.678923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0eb86b8ccf47379650595ac5e6ac5e, user_id=acadb27478ef4e9b963aae20067a5a28, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.682190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.797466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 976/1933] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:19 2022] PUT /identity/v3/projects/0f0eb86b8ccf47379650595ac5e6ac5e/users/acadb27478ef4e9b963aae20067a5a28/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:19.798321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.803274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 958/1934] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:19 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:19.805116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:19.808630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:19.825231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c3d7-a8b9-4b2e-9485-6848fd71203e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.911246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990dc4-90e1-4baf-bf8e-45baf79ab1a5 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:19.919053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.920209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.920209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.920417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.922297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:19.931866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10860395-0489-4b56-8189-11b8d783fc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:19.932533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860395-0489-4b56-8189-11b8d783fc14 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.932872 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860395-0489-4b56-8189-11b8d783fc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.933126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860395-0489-4b56-8189-11b8d783fc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:19.933777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10860395-0489-4b56-8189-11b8d783fc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:19.935403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10860395-0489-4b56-8189-11b8d783fc14 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:19.959504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 959/1935] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:19.959504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dd56d-54a4-441d-849e-c99d7fbfd9a9 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:19.959504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dd56d-54a4-441d-849e-c99d7fbfd9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:19.959504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dd56d-54a4-441d-849e-c99d7fbfd9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.017377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-530dd56d-54a4-441d-849e-c99d7fbfd9a9 None None] MFA Rules not processed for user `acadb27478ef4e9b963aae20067a5a28`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:20.019483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-530dd56d-54a4-441d-849e-c99d7fbfd9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:20.035800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.038455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.065590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 977/1936] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:20.067151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.092723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5dbf-c123-4c7a-bb90-9d27eb0942ca service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.102314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.103465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.103465 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.103640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:20.103732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.104154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.105992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.119129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 960/1937] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:20.121783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dd56d-54a4-441d-849e-c99d7fbfd9a9 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.122256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 978/1938] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:20.126350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.142070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dd56d-54a4-441d-849e-c99d7fbfd9a9 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.148656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.149985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.150419 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.150842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.162008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.162008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.164801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da354-068b-4989-9bc6-3c89b6b7e508 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.166814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:20.180948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16939e1-2d43-4db1-b048-b3bec88b2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.181619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16939e1-2d43-4db1-b048-b3bec88b2b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.181905 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16939e1-2d43-4db1-b048-b3bec88b2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.182178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16939e1-2d43-4db1-b048-b3bec88b2b4f admin admin] PATH_INFO: `/v3/projects/b0369e35f0854ef3ab8d5a7664c316c4/users/2264dbde7c3c40f8a79fead27bae2a8e/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.204265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16939e1-2d43-4db1-b048-b3bec88b2b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0369e35f0854ef3ab8d5a7664c316c4, user_id=2264dbde7c3c40f8a79fead27bae2a8e, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.207275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16939e1-2d43-4db1-b048-b3bec88b2b4f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.308055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 979/1939] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:20 2022] PUT /identity/v3/projects/b0369e35f0854ef3ab8d5a7664c316c4/users/2264dbde7c3c40f8a79fead27bae2a8e/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:20.311034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278752-0975-4616-b433-1b215de4aab3 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.311503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278752-0975-4616-b433-1b215de4aab3 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.311675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278752-0975-4616-b433-1b215de4aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.313826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 961/1940] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:20 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:20.314803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.371838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-20278752-0975-4616-b433-1b215de4aab3 None None] MFA Rules not processed for user `2264dbde7c3c40f8a79fead27bae2a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:20.373644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-20278752-0975-4616-b433-1b215de4aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:20.414092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b777f1-bda4-46b6-ba61-a550d124ae00 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.419186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.420086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.420439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.420785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.421597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.423638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.484928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 980/1941] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:20.490368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278752-0975-4616-b433-1b215de4aab3 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.501269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278752-0975-4616-b433-1b215de4aab3 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.507048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.507691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.508158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.508384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.509059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.511024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.545709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 962/1942] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:20 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:20.549575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.561825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1958-aa54-422f-bdab-c6f34b038c40 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.568008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.568623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.568890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.569720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.569831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.571589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.582123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 963/1943] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:20.587006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.597954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279009c9-5ac6-457e-9ca1-e0009b474654 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.603861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.607639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.607639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.607639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] PATH_INFO: `/v3/projects/1ed00f4129e74453b72be2013a068e29/users/38eabd68aaf048a7b1aa7f8d5e3ba760/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.621148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed00f4129e74453b72be2013a068e29, user_id=38eabd68aaf048a7b1aa7f8d5e3ba760, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.623887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.627698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 981/1944] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:20 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:20.632582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.699594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b932f-6e3c-4fd3-8e87-b8c33ea2eeed admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.704312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.704922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.705204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.705476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.706105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.708058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.717864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 964/1945] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:20 2022] PUT /identity/v3/projects/1ed00f4129e74453b72be2013a068e29/users/38eabd68aaf048a7b1aa7f8d5e3ba760/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:20.723152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.788075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 982/1946] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:20 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:20.792128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.804785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b7836-6bd4-46c0-9d74-bf61e230660b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.818132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ddaa2-6caa-40ba-b564-93cb0f3a9d72 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.823161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.824001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.824145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.824512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.825081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.826678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.838096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 965/1947] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:20.841963 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.860896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57b3f9-cd17-461c-a5b1-78406bbcf6ea admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.867058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8be18-943d-47cd-b696-5552bf0a4f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.867771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8be18-943d-47cd-b696-5552bf0a4f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.868219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8be18-943d-47cd-b696-5552bf0a4f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.868507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8be18-943d-47cd-b696-5552bf0a4f0e admin admin] PATH_INFO: `/v3/projects/1ed00f4129e74453b72be2013a068e29/users/38eabd68aaf048a7b1aa7f8d5e3ba760/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.872346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8be18-943d-47cd-b696-5552bf0a4f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed00f4129e74453b72be2013a068e29, user_id=38eabd68aaf048a7b1aa7f8d5e3ba760, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.877471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8be18-943d-47cd-b696-5552bf0a4f0e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.894297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:20.894918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.895198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.895788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.896483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:20.898140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:20.901595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 966/1948] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:20 2022] PUT /identity/v3/projects/1ed00f4129e74453b72be2013a068e29/users/38eabd68aaf048a7b1aa7f8d5e3ba760/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:20.912589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 983/1949] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:20.928448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:20.930309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a89bc9-defe-421c-9782-57d856d700ba None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:20.931816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a89bc9-defe-421c-9782-57d856d700ba None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:20.932153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a89bc9-defe-421c-9782-57d856d700ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:20.941038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffed4e-f759-49af-960b-d4353bb195df admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:20.968154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-77a89bc9-defe-421c-9782-57d856d700ba None None] MFA Rules not processed for user `38eabd68aaf048a7b1aa7f8d5e3ba760`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:20.969394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-77a89bc9-defe-421c-9782-57d856d700ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:21.016928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:21.018084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.018084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.018324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.019067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:21.022559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:21.035488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 984/1950] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:21.035488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:21.035876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:21.048348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd602ff-82e1-4995-9e5d-857b28080711 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:21.053573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:21.053983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 967/1951] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:21.054203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.054484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.054639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a89bc9-defe-421c-9782-57d856d700ba None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:21.054757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] PATH_INFO: `/v3/users/600e7911a8214c1387b4173021d6de4a` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.057385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600e7911a8214c1387b4173021d6de4a)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:21.062020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:21.070180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a89bc9-defe-421c-9782-57d856d700ba None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:21.074243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:21.075473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.075473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.075733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] PATH_INFO: `/v3/projects/ceb26c59ceea414a8e39415d99267397/users/c54642b2c68b40f0a25b6d07ee239bef/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.098642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb26c59ceea414a8e39415d99267397, user_id=c54642b2c68b40f0a25b6d07ee239bef, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:21.101837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:21.215478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 968/1952] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:21 2022] PUT /identity/v3/projects/ceb26c59ceea414a8e39415d99267397/users/c54642b2c68b40f0a25b6d07ee239bef/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:21.216242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:21.274244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53b0b0-639d-4522-9109-86b9f9ae4e08 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:21.281248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910fa69-41a4-4448-b5c5-122663a3faba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:21.281884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910fa69-41a4-4448-b5c5-122663a3faba service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.282165 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910fa69-41a4-4448-b5c5-122663a3faba service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.282433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910fa69-41a4-4448-b5c5-122663a3faba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.358955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910fa69-41a4-4448-b5c5-122663a3faba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:21.360654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910fa69-41a4-4448-b5c5-122663a3faba service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:21.374224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 969/1953] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:21.376109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.376505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.378321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.390315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600e7911a8214c1387b4173021d6de4a'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:21.391044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600e7911a8214c1387b4173021d6de4a'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:21.423729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] MFA Rules not processed for user `c54642b2c68b40f0a25b6d07ee239bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:21.425877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:21.434991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600e7911a8214c1387b4173021d6de4a'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:21.567593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600e7911a8214c1387b4173021d6de4a'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:21.568384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d32d611f-b79b-46ef-88d5-964b27112a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600e7911a8214c1387b4173021d6de4a'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:21.583981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 970/1954] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:21.584919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:21.592600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:21.598201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 985/1955] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:21 2022] DELETE /identity/v3/users/600e7911a8214c1387b4173021d6de4a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:21.603574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.603864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.604219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.667898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:21.671340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:21.776695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 986/1956] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:21.778532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:21.781381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:21.782349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595b0e-e915-49d5-b727-4c6874b25df7 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:21.794741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:21.795940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.796157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.796433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.798371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:21.805531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:21.875493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21984230-2b01-4154-8c5d-b690415697c5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:21.879479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:21.881149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:21.881619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:21.883394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:21.886146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:21.962640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:21.964218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:21.980085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 971/1957] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:21 2022] POST /identity/v3/projects => generated 385 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:21.980085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:21.983056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:22.007728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 987/1958] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:22.008697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:22.044402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0b476-35aa-4d50-a2b5-56f87e5f984d service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:22.111937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576816e-0255-4ec0-bb32-0e16989072e1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:22.118506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:22.119538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:22.120030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:22.120488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:22.167011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:22.169797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:22.171087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:22.171087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:22.183504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:22.185497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:22.189370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:22.231816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:22.234200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:22.236579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:22.254197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 972/1959] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:22.313351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 988/1960] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:22 2022] POST /identity/v3/users => generated 299 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:22.322463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:22.334812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8d563-0abe-4db3-adb0-a92505afd677 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:22.350994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:22.351685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:22.352578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:22.352578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:22.354087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:22.356760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:22.406605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 973/1961] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:22.408248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:22.423656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e8b5-efa0-4bab-af00-613c09815171 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:22.428712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:22.429545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:22.429828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:22.430188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] PATH_INFO: `/v3/projects/e9a8269c943d4694bb68fc4f066a1256/users/a91ace6eb9474f3bbefb0133b107cb32/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:22.452975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a8269c943d4694bb68fc4f066a1256, user_id=a91ace6eb9474f3bbefb0133b107cb32, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:22.456894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:22.609768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 989/1962] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:22 2022] PUT /identity/v3/projects/e9a8269c943d4694bb68fc4f066a1256/users/a91ace6eb9474f3bbefb0133b107cb32/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:22.613744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:22.625703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7800c-438e-4481-ac19-06c61778af07 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:22.722375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9a947-e321-4bbc-83ed-df0e033161bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:22.723048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9a947-e321-4bbc-83ed-df0e033161bd admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:22.723335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9a947-e321-4bbc-83ed-df0e033161bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:22.723713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9a947-e321-4bbc-83ed-df0e033161bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:22.724534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9a947-e321-4bbc-83ed-df0e033161bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:22.726385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9a947-e321-4bbc-83ed-df0e033161bd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:22.745443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 974/1963] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:22.746645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:22.758674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc9284-a8a8-4d65-8f32-34c2d8c84be4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:22.764116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:22.765197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:22.765549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:22.765900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] PATH_INFO: `/v3/projects/e9a8269c943d4694bb68fc4f066a1256/users/a91ace6eb9474f3bbefb0133b107cb32/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:22.774104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a8269c943d4694bb68fc4f066a1256, user_id=a91ace6eb9474f3bbefb0133b107cb32, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:22.776282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:22.804026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 990/1964] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:22 2022] PUT /identity/v3/projects/e9a8269c943d4694bb68fc4f066a1256/users/a91ace6eb9474f3bbefb0133b107cb32/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:22.816105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:22.816411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:22.816697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:22.851992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] MFA Rules not processed for user `a91ace6eb9474f3bbefb0133b107cb32`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:22.853538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:22.962516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 975/1965] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:22.970940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:23.071369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b463d-9eed-4555-a4ba-16eb03e2d36e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:23.076348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:23.076950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:23.077227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:23.077495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:23.093127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:23.094707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:23.106716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 991/1966] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:23.189150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:23.192710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:23.302676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cfbe0-5d21-431a-b867-3392e7ba9640 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:23.307449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:23.308110 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:23.308388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:23.310653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] PATH_INFO: `/v3/projects/d1e224a8d9f34a6a9e7eddff1b736fd5` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:23.310653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e224a8d9f34a6a9e7eddff1b736fd5)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:23.311850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:23.509959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e224a8d9f34a6a9e7eddff1b736fd5', 'request_id': 'req-c66bf89b-d046-48ba-a5a7-50039ca4d610'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:23.517326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e224a8d9f34a6a9e7eddff1b736fd5', 'request_id': 'req-c66bf89b-d046-48ba-a5a7-50039ca4d610'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:23.527167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:23.655194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e224a8d9f34a6a9e7eddff1b736fd5', 'request_id': 'req-c66bf89b-d046-48ba-a5a7-50039ca4d610'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:23.672532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] The token cache is being invalidate because project d1e224a8d9f34a6a9e7eddff1b736fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:23.672851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:23.674503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:23.676884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 976/1967] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:23 2022] DELETE /identity/v3/projects/d1e224a8d9f34a6a9e7eddff1b736fd5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:23.681602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:23.699094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52419e-9344-46a1-9e64-3d3a494b7984 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:23.780199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:23.780847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:23.781496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:23.781496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] PATH_INFO: `/v3/users/3ce79cea9ce643ed9583200b0dc20644` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:23.782632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce79cea9ce643ed9583200b0dc20644)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:23.784795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:23.987550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:24.035986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce79cea9ce643ed9583200b0dc20644'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:24.039892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce79cea9ce643ed9583200b0dc20644'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:24.055105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce79cea9ce643ed9583200b0dc20644'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:24.197365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce79cea9ce643ed9583200b0dc20644'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:24.198444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce79cea9ce643ed9583200b0dc20644'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:24.215556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 992/1968] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:23 2022] DELETE /identity/v3/users/3ce79cea9ce643ed9583200b0dc20644 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:24.897746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:24.899472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:24.964417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:24.966446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:24.975121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bf89b-d046-48ba-a5a7-50039ca4d610 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:25.040363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:25.072368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:25.073002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:25.073283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:25.073557 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:25.076550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:25.096462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60f96-8f9b-4fe2-a86b-5b2c5e970e9e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:25.107623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:25.108282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:25.108565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:25.108841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] PATH_INFO: `/v3/projects/3c2b45f73a4f4680938dd2fa638d3bfc` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:25.110267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2b45f73a4f4680938dd2fa638d3bfc)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:25.112251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:25.152998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:25.154441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:25.165069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 977/1969] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:25.271697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2b45f73a4f4680938dd2fa638d3bfc', 'request_id': 'req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.278184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2b45f73a4f4680938dd2fa638d3bfc', 'request_id': 'req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.420624 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2b45f73a4f4680938dd2fa638d3bfc', 'request_id': 'req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.439763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] The token cache is being invalidate because project 3c2b45f73a4f4680938dd2fa638d3bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:25.440065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.440882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.442738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 993/1970] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:24 2022] DELETE /identity/v3/projects/3c2b45f73a4f4680938dd2fa638d3bfc => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:25.447409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:25.458020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e25f-2f49-4e0e-a7c1-80a37c393586 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:25.531363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:25.532407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:25.532769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:25.533054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] PATH_INFO: `/v3/users/f287d4f3905849fa9eb591aaa9d6d7f4` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:25.534404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f287d4f3905849fa9eb591aaa9d6d7f4)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:25.537014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:25.771957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f287d4f3905849fa9eb591aaa9d6d7f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.773153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f287d4f3905849fa9eb591aaa9d6d7f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.792235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f287d4f3905849fa9eb591aaa9d6d7f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.929999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f287d4f3905849fa9eb591aaa9d6d7f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.931600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f287d4f3905849fa9eb591aaa9d6d7f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:25.945254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 978/1971] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:25 2022] DELETE /identity/v3/users/f287d4f3905849fa9eb591aaa9d6d7f4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:26.493787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:26.495378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:26.516521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8725-7ec1-40f8-92c0-947ff3f0c68d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:26.578716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:26.579402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:26.579737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:26.579985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] PATH_INFO: `/v3/projects/729a30d8d61e44eb86c90b2f093f9c0c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:26.581254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=729a30d8d61e44eb86c90b2f093f9c0c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:26.583999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:26.724933 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:26.726164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:26.730578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729a30d8d61e44eb86c90b2f093f9c0c', 'request_id': 'req-0685c203-77e6-4cf0-928d-e60d858c4f0e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:26.740077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:26.742683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729a30d8d61e44eb86c90b2f093f9c0c', 'request_id': 'req-0685c203-77e6-4cf0-928d-e60d858c4f0e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:26.747395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812eff-6171-4e59-be4c-42daa1f4ab6d admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:26.793645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:26.804737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:26.805387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:26.805671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:26.805948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] PATH_INFO: `/v3/users/57b3953d16d34113aee5780f59b5ef67` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:26.807095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b3953d16d34113aee5780f59b5ef67)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:26.809053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:26.819735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729a30d8d61e44eb86c90b2f093f9c0c', 'request_id': 'req-0685c203-77e6-4cf0-928d-e60d858c4f0e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:26.834727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] The token cache is being invalidate because project 729a30d8d61e44eb86c90b2f093f9c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:26.835050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:26.836231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0685c203-77e6-4cf0-928d-e60d858c4f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:26.837410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 994/1972] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:26 2022] DELETE /identity/v3/projects/729a30d8d61e44eb86c90b2f093f9c0c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:26.843176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639bc4-9bdb-4c82-bc8a-ae11df9bbc5f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:26.843591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639bc4-9bdb-4c82-bc8a-ae11df9bbc5f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:26.843938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b639bc4-9bdb-4c82-bc8a-ae11df9bbc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:26.865766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9b639bc4-9bdb-4c82-bc8a-ae11df9bbc5f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:26.867109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9b639bc4-9bdb-4c82-bc8a-ae11df9bbc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:26.875960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 995/1973] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:26.886745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2669f6-35d0-45ca-9f0b-8d26eb5810ef None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:26.887024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2669f6-35d0-45ca-9f0b-8d26eb5810ef None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:26.887299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2669f6-35d0-45ca-9f0b-8d26eb5810ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:26.913679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-5b2669f6-35d0-45ca-9f0b-8d26eb5810ef None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:26.913679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5b2669f6-35d0-45ca-9f0b-8d26eb5810ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:26.920585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 996/1974] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:26.928009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2669f6-35d0-45ca-9f0b-8d26eb5810ef None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:26.938746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2669f6-35d0-45ca-9f0b-8d26eb5810ef None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:26.944400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:26.945061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:26.945335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:26.945605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:26.946272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:26.946637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:26.948288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:26.964956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 997/1975] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:50:26.966103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:26.976368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710784f8-59fe-48f0-89f9-4cd0dfc86952 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:26.981106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:26.981749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:26.982028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:26.982299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:26.982977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:26.984969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.007552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b3953d16d34113aee5780f59b5ef67'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.008210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b3953d16d34113aee5780f59b5ef67'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.020935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b3953d16d34113aee5780f59b5ef67'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.066982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 998/1976] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:26 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:27.072267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.073957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:27.110961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b3953d16d34113aee5780f59b5ef67'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.111639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d08ea6a7-eef5-4ef0-b0a9-f565a7462abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b3953d16d34113aee5780f59b5ef67'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.125699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 979/1977] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:26 2022] DELETE /identity/v3/users/57b3953d16d34113aee5780f59b5ef67 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:27.130835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.131267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.131376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.155554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:27.157605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:27.164818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa0181-a020-455c-b529-fa0f31cdb8ef admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:27.232520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 980/1978] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:27.244427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.247655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:27.257466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:27.258328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.258627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.258951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.259804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:27.264429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.335499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc1c8-2a16-4dfc-bdf3-44941826929e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:27.339719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:27.340340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.340620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.340894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.352957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:27.355965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.359611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 999/1979] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:27 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:27.370499 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.384533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 981/1980] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:27.390893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.393326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:27.397860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94319fa-d9a3-4f0a-bdac-39cf4f09d87f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:27.405551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:27.406047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.406606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.407107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.407933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:27.409953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.410538 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e741d-f1b3-4ddc-8988-ce1503bc8045 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:27.418906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:27.420528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.421459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.422187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] PATH_INFO: `/v3/users/acadb27478ef4e9b963aae20067a5a28` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.424328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acadb27478ef4e9b963aae20067a5a28)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:27.424840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1000/1981] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:27.428254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.429202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.443538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bdee2-ca19-4bd5-9121-1374aef38c45 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:27.451793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:27.457120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.457120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.457120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.457120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:27.457120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.475453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1001/1982] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:27.484725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.504883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04a5d4-74cf-427c-b88d-7e8c58e04858 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:27.512661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1c3f2-9c96-43dc-a01f-579439e002c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:27.513339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c3f2-9c96-43dc-a01f-579439e002c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.513619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c3f2-9c96-43dc-a01f-579439e002c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.513894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c3f2-9c96-43dc-a01f-579439e002c6 admin admin] PATH_INFO: `/v3/projects/bcf35816c6334b09af9a9949b89a2eb9/users/99bba3661bc74dab9b7a450eb6bec4b6/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.530284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1c3f2-9c96-43dc-a01f-579439e002c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf35816c6334b09af9a9949b89a2eb9, user_id=99bba3661bc74dab9b7a450eb6bec4b6, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:27.532942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1c3f2-9c96-43dc-a01f-579439e002c6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.635756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1002/1983] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:27 2022] PUT /identity/v3/projects/bcf35816c6334b09af9a9949b89a2eb9/users/99bba3661bc74dab9b7a450eb6bec4b6/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:27.648347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.648641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.649000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.683232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acadb27478ef4e9b963aae20067a5a28'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.685539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acadb27478ef4e9b963aae20067a5a28'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.689952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] MFA Rules not processed for user `99bba3661bc74dab9b7a450eb6bec4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:27.691175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:27.712285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acadb27478ef4e9b963aae20067a5a28'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.764787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1003/1984] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:27.768374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:27.769059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.771776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:27.798201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acadb27478ef4e9b963aae20067a5a28'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.798980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ec037cd0-0bd8-42d4-936a-5582e1979c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acadb27478ef4e9b963aae20067a5a28'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:27.808810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:27.820980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 982/1985] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:27 2022] DELETE /identity/v3/users/acadb27478ef4e9b963aae20067a5a28 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:27.823492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.830248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.830248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.849542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:27.850566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:27.851219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f29494-0d1a-4898-9999-6574dd553aeb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:27.925568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:27.925568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:27.925568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:27.925568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:27.926144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:27.926144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:27.936284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 983/1986] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:27.947164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:27.949541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.009857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f711673-7f6c-46d1-b798-680cdcd538e4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.014227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.014837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.015120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.015395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.025135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.026547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.035903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 984/1987] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:28.037332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.038597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.051627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1004/1988] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:27 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:28.052033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ae36c-7c17-48ac-a522-d7a3d4f89aff service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.057484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.113635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.114349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.114655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.114961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] PATH_INFO: `/v3/projects/d6ba592676584a0f85cc620fbadccebc` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.116152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ba592676584a0f85cc620fbadccebc)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.118192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.134255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f95199-083a-4599-b51e-6ea069d8e6df admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.140215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.140961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.141249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.141525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.142398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.144489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.231695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ba592676584a0f85cc620fbadccebc', 'request_id': 'req-e8c9f5cc-4436-4177-94b6-5901fb647a6f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.238102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ba592676584a0f85cc620fbadccebc', 'request_id': 'req-e8c9f5cc-4436-4177-94b6-5901fb647a6f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.249865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1005/1989] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:28 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:28.256930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.268744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e13708-3646-4c5f-b760-9700f5d07e3a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.313215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ba592676584a0f85cc620fbadccebc', 'request_id': 'req-e8c9f5cc-4436-4177-94b6-5901fb647a6f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.328207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] The token cache is being invalidate because project d6ba592676584a0f85cc620fbadccebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:28.328584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.329317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.331235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 985/1990] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:28 2022] DELETE /identity/v3/projects/d6ba592676584a0f85cc620fbadccebc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:28.331343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.332125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.332432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.332704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.334044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.336185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.336314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.337427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.347927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1006/1991] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:28.351737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9f5cc-4436-4177-94b6-5901fb647a6f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.351892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.353971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.356885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.357631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.358135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.358702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] PATH_INFO: `/v3/users/0644cb3325194577be724aade9db60d2` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.360677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0644cb3325194577be724aade9db60d2)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.363733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.366868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c72c-94b9-4886-985b-de3ea647c7eb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.373914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.374769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.374976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.375234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] PATH_INFO: `/v3/projects/455aec56628e4d5c8a10ddf355ca0e8e/users/90565f2228a44f02a927d42096960eed/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.392020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:28.393660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455aec56628e4d5c8a10ddf355ca0e8e, user_id=90565f2228a44f02a927d42096960eed, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.397020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.500437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1007/1992] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:28 2022] PUT /identity/v3/projects/455aec56628e4d5c8a10ddf355ca0e8e/users/90565f2228a44f02a927d42096960eed/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:28.501277 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.502874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.558908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0644cb3325194577be724aade9db60d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.559627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0644cb3325194577be724aade9db60d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.572292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0644cb3325194577be724aade9db60d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.578566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672fc9-b47e-417f-b782-2228231c89d0 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.584062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.585798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.585798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.585798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] PATH_INFO: `/v3/projects/0f0eb86b8ccf47379650595ac5e6ac5e` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.586495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0eb86b8ccf47379650595ac5e6ac5e)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.588556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.631738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0644cb3325194577be724aade9db60d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.632401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0644cb3325194577be724aade9db60d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.645733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 986/1993] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:28 2022] DELETE /identity/v3/users/0644cb3325194577be724aade9db60d2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:28.647090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.648513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.713376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:28.740161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0eb86b8ccf47379650595ac5e6ac5e', 'request_id': 'req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.749539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0db2f-c42f-4e28-ba52-b04608abccec admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.750708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0eb86b8ccf47379650595ac5e6ac5e', 'request_id': 'req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.813821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.814438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.814780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.814973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.815643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.817237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.830818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 987/1994] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:28.831832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.842772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0eb86b8ccf47379650595ac5e6ac5e', 'request_id': 'req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.846700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b22de-883c-4261-a213-ded767ee98ab admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.853765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c7cb0-adb9-4b56-a861-0f2cf849af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.854460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c7cb0-adb9-4b56-a861-0f2cf849af58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.855599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c7cb0-adb9-4b56-a861-0f2cf849af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.855893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c7cb0-adb9-4b56-a861-0f2cf849af58 admin admin] PATH_INFO: `/v3/projects/455aec56628e4d5c8a10ddf355ca0e8e/users/90565f2228a44f02a927d42096960eed/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.857286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] The token cache is being invalidate because project 0f0eb86b8ccf47379650595ac5e6ac5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:28.857844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.858460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c7cb0-adb9-4b56-a861-0f2cf849af58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455aec56628e4d5c8a10ddf355ca0e8e, user_id=90565f2228a44f02a927d42096960eed, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.858918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:28.860898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1008/1995] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:28 2022] DELETE /identity/v3/projects/0f0eb86b8ccf47379650595ac5e6ac5e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:28.867178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c7cb0-adb9-4b56-a861-0f2cf849af58 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:28.867316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:28.867776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.882664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 988/1996] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:28 2022] PUT /identity/v3/projects/455aec56628e4d5c8a10ddf355ca0e8e/users/90565f2228a44f02a927d42096960eed/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:28.883298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c6cf7-8568-46fd-b343-4a0e0e8eb1ca admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:28.894838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.895135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.897172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.953633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] MFA Rules not processed for user `90565f2228a44f02a927d42096960eed`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:28.953633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:28.979754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:28.982525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:28.982525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:28.982525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] PATH_INFO: `/v3/users/38eabd68aaf048a7b1aa7f8d5e3ba760` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:28.982525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38eabd68aaf048a7b1aa7f8d5e3ba760)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:28.984468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:29.037873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 989/1997] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:29.051038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:29.053211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:29.111048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6c5c6-c079-4157-876e-4ff7c77a62fe None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:29.115601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:29.116214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:29.116490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:29.116763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:29.125930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:29.127378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:29.137353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 990/1998] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:29.184755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38eabd68aaf048a7b1aa7f8d5e3ba760'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.185664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38eabd68aaf048a7b1aa7f8d5e3ba760'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.187265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:29.190156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:29.200691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38eabd68aaf048a7b1aa7f8d5e3ba760'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.204129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dad10e-913c-4e7c-8763-cd1f2e470a53 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:29.209448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:29.210202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:29.210554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:29.210905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] PATH_INFO: `/v3/projects/965c1b47bf014b74942b30e1357adb09` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:29.212322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965c1b47bf014b74942b30e1357adb09)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:29.214585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:29.282402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38eabd68aaf048a7b1aa7f8d5e3ba760'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.283235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38eabd68aaf048a7b1aa7f8d5e3ba760'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.303692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1009/1999] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:28 2022] DELETE /identity/v3/users/38eabd68aaf048a7b1aa7f8d5e3ba760 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:29.365843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:29.370603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:29.373019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965c1b47bf014b74942b30e1357adb09', 'request_id': 'req-4d98903a-c395-4340-8760-a2c22fbf2aa9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.386087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965c1b47bf014b74942b30e1357adb09', 'request_id': 'req-4d98903a-c395-4340-8760-a2c22fbf2aa9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.455505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f8d20-0ead-47ed-a7a9-58ccad3c4d3c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:29.470919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965c1b47bf014b74942b30e1357adb09', 'request_id': 'req-4d98903a-c395-4340-8760-a2c22fbf2aa9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.485762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] The token cache is being invalidate because project 965c1b47bf014b74942b30e1357adb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:29.485762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.486837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.488591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 991/2000] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:29 2022] DELETE /identity/v3/projects/965c1b47bf014b74942b30e1357adb09 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:29.496154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:29.496154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:29.517571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:29.519082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:29.519616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:29.520077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:29.523106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:29.594301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98903a-c395-4340-8760-a2c22fbf2aa9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:29.602301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:29.603077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:29.603364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:29.603722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] PATH_INFO: `/v3/users/3b0ca95d25754657ad2ec1e45fa448e2` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:29.604882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0ca95d25754657ad2ec1e45fa448e2)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:29.607334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:29.609375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:29.611509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:29.622074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1010/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:29.762942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:29.800710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0ca95d25754657ad2ec1e45fa448e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.801417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0ca95d25754657ad2ec1e45fa448e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.814747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:29.820475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0ca95d25754657ad2ec1e45fa448e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.826336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:29.827856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:29.853353 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52fb46-38fd-4951-b8a7-2cb28bec81b3 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:29.867877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:29.868627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:29.868973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:29.869346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] PATH_INFO: `/v3/projects/1ed00f4129e74453b72be2013a068e29` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:29.870731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed00f4129e74453b72be2013a068e29)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:29.872842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:29.926935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0ca95d25754657ad2ec1e45fa448e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.932118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-09878f89-59a1-4676-a7dd-719472eba0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0ca95d25754657ad2ec1e45fa448e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:29.941408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 992/2002] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:29 2022] DELETE /identity/v3/users/3b0ca95d25754657ad2ec1e45fa448e2 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:30.118522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed00f4129e74453b72be2013a068e29', 'request_id': 'req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.125334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed00f4129e74453b72be2013a068e29', 'request_id': 'req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.225975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed00f4129e74453b72be2013a068e29', 'request_id': 'req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.244947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] The token cache is being invalidate because project 1ed00f4129e74453b72be2013a068e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:30.244947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.245360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-e4d95791-151c-4e76-8d7b-4bf57a9dc20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.250495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1011/2003] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:29 2022] DELETE /identity/v3/projects/1ed00f4129e74453b72be2013a068e29 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:30.252331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efc11-acdf-48bd-a007-5e0c5f4bb205 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.252786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efc11-acdf-48bd-a007-5e0c5f4bb205 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.252890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efc11-acdf-48bd-a007-5e0c5f4bb205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.278049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-e16efc11-acdf-48bd-a007-5e0c5f4bb205 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:30.280079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e16efc11-acdf-48bd-a007-5e0c5f4bb205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.404572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 993/2004] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:30.413132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.413418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.413698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.439083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:30.440433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.450089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1012/2005] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:30.454160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16efc11-acdf-48bd-a007-5e0c5f4bb205 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.465659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.467067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.474506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16efc11-acdf-48bd-a007-5e0c5f4bb205 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.489054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:30.490565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.490966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.491754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.492519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:30.493025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:30.494883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:30.517483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c375d7-8bbd-48c3-b782-1ab1158a2bbe None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.519796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 994/2006] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:30.524875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.527597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:30.529392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:30.529869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.530541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.531005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] PATH_INFO: `/v3/projects/6b293f6382f64e8f9cd21a93e5812c00` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.534061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b293f6382f64e8f9cd21a93e5812c00)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:30.539073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9faf0-96e7-49aa-b0d2-630622e5afa2 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.539342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:30.542339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:30.543178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.543560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.543998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.544716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:30.546809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:30.649349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b293f6382f64e8f9cd21a93e5812c00', 'request_id': 'req-8db4865c-3a46-4ba5-9294-16141e87a85c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.652384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 995/2007] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:30 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:30.653657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.656311 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b293f6382f64e8f9cd21a93e5812c00', 'request_id': 'req-8db4865c-3a46-4ba5-9294-16141e87a85c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.705395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b293f6382f64e8f9cd21a93e5812c00', 'request_id': 'req-8db4865c-3a46-4ba5-9294-16141e87a85c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.717446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] The token cache is being invalidate because project 6b293f6382f64e8f9cd21a93e5812c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:30.718320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.718573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8db4865c-3a46-4ba5-9294-16141e87a85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:30.720588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1013/2008] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:30 2022] DELETE /identity/v3/projects/6b293f6382f64e8f9cd21a93e5812c00 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:30.733166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a517-d410-493c-bbdb-39a23707ccaf None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.733547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a517-d410-493c-bbdb-39a23707ccaf None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.733839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10a517-d410-493c-bbdb-39a23707ccaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.734847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02436834-82c1-45fe-8c3d-fcf6d33bd883 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.742350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:30.742350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.742350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.742350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.742715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:30.744551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:30.755715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ee10a517-d410-493c-bbdb-39a23707ccaf None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:30.757170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ee10a517-d410-493c-bbdb-39a23707ccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.765846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1014/2009] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:30.777875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.777875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.777875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.795697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:30.796821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.804900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1015/2010] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:30.805738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.807079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.861815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d44e-315e-42cb-a68d-4487078fa566 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.867389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:30.868021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.868297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.868570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.870337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.917593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 996/2011] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:30 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:30.918729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.932972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b9de-ae3d-4701-b160-ad08f234e232 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.935205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:30.936937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:30.941676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:30.942580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.942871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.943153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.943848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:30.954661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:30.954661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:30.955390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1016/2012] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:30.956399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.960300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:30.964511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 997/2013] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:30.969966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:30.977629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5645c82-9cfa-48ea-8b33-fa22a16e7dff service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.983717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d7ed-a81a-4a86-a22c-b33478c8627f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:30.984145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:30.984768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:30.985056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:30.985332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:30.985987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:30.988066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.002059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1017/2014] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:31.006372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.007314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.007455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.008911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.009479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.010958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.013193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.021072 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac6a2-2e50-40b8-bd8a-3460234d5782 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.032283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.032283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.032283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.032283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.032681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.034514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.056021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1018/2015] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:31.057385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.073180 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008290b8-efc0-43a7-a368-a8143a8d3be4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.078577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8749b-c1ea-4ddd-841c-d475fcee6aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.079297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8749b-c1ea-4ddd-841c-d475fcee6aba admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.079627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8749b-c1ea-4ddd-841c-d475fcee6aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.079907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8749b-c1ea-4ddd-841c-d475fcee6aba admin admin] PATH_INFO: `/v3/projects/69fad2a190444b58b3fb6fd5ee779a5c/users/6d5ebebff9e7467d9b8e176ce8294372/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.102285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8749b-c1ea-4ddd-841c-d475fcee6aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fad2a190444b58b3fb6fd5ee779a5c, user_id=6d5ebebff9e7467d9b8e176ce8294372, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.107200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8749b-c1ea-4ddd-841c-d475fcee6aba admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.118952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 998/2016] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:30 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:31.123861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.162826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1019/2017] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:31 2022] PUT /identity/v3/projects/69fad2a190444b58b3fb6fd5ee779a5c/users/6d5ebebff9e7467d9b8e176ce8294372/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:31.174580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067d77-a818-4df3-97e2-53a7bfc2bab8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.174865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067d77-a818-4df3-97e2-53a7bfc2bab8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.175140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067d77-a818-4df3-97e2-53a7bfc2bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.175631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:31.190136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2b52f-68f5-49b6-931f-d6e1bd7dba8d admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.204391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-68067d77-a818-4df3-97e2-53a7bfc2bab8 None None] MFA Rules not processed for user `6d5ebebff9e7467d9b8e176ce8294372`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:31.205957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-68067d77-a818-4df3-97e2-53a7bfc2bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:31.251166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.252087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.252527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.253499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.254274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.256623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.274519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1020/2018] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:31.279058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067d77-a818-4df3-97e2-53a7bfc2bab8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.290613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067d77-a818-4df3-97e2-53a7bfc2bab8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.295189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.295849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.296135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.296412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.297045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.299002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.373646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 999/2019] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:31 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:31.377839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.388799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9296fcf-5adc-48c2-8786-ac4f8c2a72b0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.393630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.394355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.394999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.395299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.396785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.402899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.410473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1021/2020] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:31 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:31.413869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1000/2021] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:31.415833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.417843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.431589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec0ed-5f10-4ba9-92fc-cf2c2611524e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.492625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e0f28-955f-485f-960c-e58d885b7ddd admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.497430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.498117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.498436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.498675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.498786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.499407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.499564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.499955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.500325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.501107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.501416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.502889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.517041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1001/2022] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:31.522291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.533627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83cbe-badc-4f0e-85b3-805069af0f87 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.543567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1459a1d-80c7-49e3-bf34-e58b95a6fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.543567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459a1d-80c7-49e3-bf34-e58b95a6fbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.543567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459a1d-80c7-49e3-bf34-e58b95a6fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.543567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1459a1d-80c7-49e3-bf34-e58b95a6fbc5 admin admin] PATH_INFO: `/v3/projects/ed757a2c7eeb4c36bb1f6b4b6fec0eae/users/79b088bd27a146adbfa73e7082be7e23/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.565966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459a1d-80c7-49e3-bf34-e58b95a6fbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed757a2c7eeb4c36bb1f6b4b6fec0eae, user_id=79b088bd27a146adbfa73e7082be7e23, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.569527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1459a1d-80c7-49e3-bf34-e58b95a6fbc5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.638068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1022/2023] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:31 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:31.641936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.655937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78425ba-974e-4f38-bbeb-dc90089cf25f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.662982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.663629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.664226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.664508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.665155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.666799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.678258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1023/2025] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:31.678485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1002/2025] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:31 2022] PUT /identity/v3/projects/ed757a2c7eeb4c36bb1f6b4b6fec0eae/users/79b088bd27a146adbfa73e7082be7e23/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:31.683071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.694191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a3c6-68f7-4484-94a0-96d8798dc061 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.694401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4135f-a5c5-40f3-a5e2-bc2e839baff7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.694757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a3c6-68f7-4484-94a0-96d8798dc061 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.695112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418a3c6-68f7-4484-94a0-96d8798dc061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.728350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8418a3c6-68f7-4484-94a0-96d8798dc061 None None] MFA Rules not processed for user `79b088bd27a146adbfa73e7082be7e23`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:31.730429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8418a3c6-68f7-4484-94a0-96d8798dc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:31.768974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.769643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.769945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.770199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] PATH_INFO: `/v3/projects/7c15e4dfbe7b437687e207b58ffac177/users/50a86eaa198e482e8bc8a06f4fdef4c4/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.784804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c15e4dfbe7b437687e207b58ffac177, user_id=50a86eaa198e482e8bc8a06f4fdef4c4, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.787543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.809954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1003/2026] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:31.860213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1024/2027] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:31 2022] PUT /identity/v3/projects/7c15e4dfbe7b437687e207b58ffac177/users/50a86eaa198e482e8bc8a06f4fdef4c4/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:31.864833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418a3c6-68f7-4484-94a0-96d8798dc061 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.877318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418a3c6-68f7-4484-94a0-96d8798dc061 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.934656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5d9ca-e3ff-48df-ae39-1f4c8aad88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.948007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5d9ca-e3ff-48df-ae39-1f4c8aad88c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.948007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5d9ca-e3ff-48df-ae39-1f4c8aad88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.948007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5d9ca-e3ff-48df-ae39-1f4c8aad88c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.948007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5d9ca-e3ff-48df-ae39-1f4c8aad88c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.948007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5d9ca-e3ff-48df-ae39-1f4c8aad88c2 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.948007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1004/2028] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:31.952220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:31.962341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e8e39-fe5b-40ec-bedb-64a067f4bdc5 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:31.969252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:31.969913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.970191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.970463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] PATH_INFO: `/v3/projects/7c15e4dfbe7b437687e207b58ffac177/users/50a86eaa198e482e8bc8a06f4fdef4c4/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:31.973133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c15e4dfbe7b437687e207b58ffac177, user_id=50a86eaa198e482e8bc8a06f4fdef4c4, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:31.977481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:31.986607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1025/2029] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:31 2022] PUT /identity/v3/projects/7c15e4dfbe7b437687e207b58ffac177/users/50a86eaa198e482e8bc8a06f4fdef4c4/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:31.997956 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be9343-79da-4095-a41f-30d126b84933 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:31.998288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be9343-79da-4095-a41f-30d126b84933 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:31.998595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be9343-79da-4095-a41f-30d126b84933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:32.025757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-26be9343-79da-4095-a41f-30d126b84933 None None] MFA Rules not processed for user `50a86eaa198e482e8bc8a06f4fdef4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:32.026948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-26be9343-79da-4095-a41f-30d126b84933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:32.094969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1005/2030] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:32.142043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:32.146172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:32.203131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f51ca-e140-415f-a28c-cc469d7671a6 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:32.206758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:32.209369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:32.209369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:32.209369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:32.263910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:32.265348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:32.274650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1026/2031] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:32.469733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be9343-79da-4095-a41f-30d126b84933 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:32.479995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be9343-79da-4095-a41f-30d126b84933 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:32.485352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:32.485352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:32.485943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:32.486208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:32.486510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:32.549798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:32.551179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:32.560272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1006/2032] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:32.768365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:33.328126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:33.602775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:34.408117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:34.602833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:35.379867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:35.671246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:36.219936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:36.356572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:36.370782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a01a5-cd3d-4e2b-b82d-1532fd98108f service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:36.370782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965b02f-fb9c-4173-81ff-f713e84a3066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:36.371143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965b02f-fb9c-4173-81ff-f713e84a3066 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:36.371255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965b02f-fb9c-4173-81ff-f713e84a3066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:36.371519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965b02f-fb9c-4173-81ff-f713e84a3066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:36.381520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965b02f-fb9c-4173-81ff-f713e84a3066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:36.383027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965b02f-fb9c-4173-81ff-f713e84a3066 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:36.393535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1027/2033] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:36.830353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:36.833914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:36.940748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:36.946459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145cfee-af59-4d35-9e2d-37b3f31e215b service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:36.957385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:36.959372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:36.959372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:36.960426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] PATH_INFO: `/v3/users/2264dbde7c3c40f8a79fead27bae2a8e` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:36.961434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2264dbde7c3c40f8a79fead27bae2a8e)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:36.963685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:37.118825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2264dbde7c3c40f8a79fead27bae2a8e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:37.119529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2264dbde7c3c40f8a79fead27bae2a8e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:37.133018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2264dbde7c3c40f8a79fead27bae2a8e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:37.213441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2264dbde7c3c40f8a79fead27bae2a8e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:37.214074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2264dbde7c3c40f8a79fead27bae2a8e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:37.232305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1007/2034] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:36 2022] DELETE /identity/v3/users/2264dbde7c3c40f8a79fead27bae2a8e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:37.236650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:37.237151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:37.237246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:37.257264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:37.258517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:37.321981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1028/2035] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:37.337583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:37.339632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:37.408576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:37.474767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033aebd-8717-491a-8f9f-2dd3239a0090 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:37.487750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ffe6-7fb0-4bea-b5d9-6be6fcf8e188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:37.488391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ffe6-7fb0-4bea-b5d9-6be6fcf8e188 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:37.488677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ffe6-7fb0-4bea-b5d9-6be6fcf8e188 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:37.490327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ffe6-7fb0-4bea-b5d9-6be6fcf8e188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:37.514447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9ffe6-7fb0-4bea-b5d9-6be6fcf8e188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:37.516049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9ffe6-7fb0-4bea-b5d9-6be6fcf8e188 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:37.531036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1008/2036] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:37.808695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:37.811078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:37.825127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac1f65-3b13-4371-81b7-fea9339afa7d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:37.833230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:37.833230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:37.833230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:37.833230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] PATH_INFO: `/v3/users/99bba3661bc74dab9b7a450eb6bec4b6` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:37.834796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bba3661bc74dab9b7a450eb6bec4b6)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:37.837166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:38.002013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:38.072170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bba3661bc74dab9b7a450eb6bec4b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.073123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bba3661bc74dab9b7a450eb6bec4b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.087785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bba3661bc74dab9b7a450eb6bec4b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.157167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bba3661bc74dab9b7a450eb6bec4b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.158685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bba3661bc74dab9b7a450eb6bec4b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.175156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1029/2037] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:37 2022] DELETE /identity/v3/users/99bba3661bc74dab9b7a450eb6bec4b6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:38.179759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:38.180053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:38.180333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:38.200831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:38.202065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:38.260097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1009/2038] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:38.270104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:38.271685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:38.285583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:38.287341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:38.311722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfa2da-4513-40c6-b945-4ecc840d56dd None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:38.318718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:38.319812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:38.320057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:38.320444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] PATH_INFO: `/v3/projects/b0369e35f0854ef3ab8d5a7664c316c4` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:38.322145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0369e35f0854ef3ab8d5a7664c316c4)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:38.324639 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:38.347320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d1ed1-7017-4204-9cf9-03ee6b5fbd3e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:38.351835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:38.352401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:38.352679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:38.352950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:38.362609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:38.365241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:38.374144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1030/2039] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:38.457728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0369e35f0854ef3ab8d5a7664c316c4', 'request_id': 'req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.466479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0369e35f0854ef3ab8d5a7664c316c4', 'request_id': 'req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.539630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0369e35f0854ef3ab8d5a7664c316c4', 'request_id': 'req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.553617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] The token cache is being invalidate because project b0369e35f0854ef3ab8d5a7664c316c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:38.554244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.560608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:38.562667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1010/2040] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:38 2022] DELETE /identity/v3/projects/b0369e35f0854ef3ab8d5a7664c316c4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:38.566847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:38.585530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c635348-fd1e-4e62-ab84-8be5133a3088 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:38.693835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:38.694487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:38.694769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:38.695045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] PATH_INFO: `/v3/users/c54642b2c68b40f0a25b6d07ee239bef` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:38.710516 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54642b2c68b40f0a25b6d07ee239bef)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:38.715394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:38.716854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:38.842534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:38.941365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:38.950230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:38.985876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a72b74-0aa0-4258-bed9-2c2d2ea02afa admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:39.006586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:39.007756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54642b2c68b40f0a25b6d07ee239bef'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.009113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:39.009528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54642b2c68b40f0a25b6d07ee239bef'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.010026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:39.011776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] PATH_INFO: `/v3/projects/bcf35816c6334b09af9a9949b89a2eb9` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:39.014252 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf35816c6334b09af9a9949b89a2eb9)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:39.019824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:39.032842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54642b2c68b40f0a25b6d07ee239bef'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.162845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54642b2c68b40f0a25b6d07ee239bef'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.163629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54642b2c68b40f0a25b6d07ee239bef'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.193130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1031/2041] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:38 2022] DELETE /identity/v3/users/c54642b2c68b40f0a25b6d07ee239bef => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:39.235094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf35816c6334b09af9a9949b89a2eb9', 'request_id': 'req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.245622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf35816c6334b09af9a9949b89a2eb9', 'request_id': 'req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.397153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf35816c6334b09af9a9949b89a2eb9', 'request_id': 'req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.445492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] The token cache is being invalidate because project bcf35816c6334b09af9a9949b89a2eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:39.446145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.447771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.450315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1011/2042] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:38 2022] DELETE /identity/v3/projects/bcf35816c6334b09af9a9949b89a2eb9 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:39.454545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:39.456383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:39.580462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1bd9d-d6f1-4eeb-a4b1-7f595f44e2b4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:39.680774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:39.681384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:39.681689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:39.681932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] PATH_INFO: `/v3/users/90565f2228a44f02a927d42096960eed` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:39.683114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90565f2228a44f02a927d42096960eed)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:39.686216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:39.799014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:39.800598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:39.823113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a4de2-02f7-4745-bb66-fe80ba5a2984 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:39.829643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:39.831035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:39.831575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:39.832082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] PATH_INFO: `/v3/projects/ceb26c59ceea414a8e39415d99267397` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:39.836698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb26c59ceea414a8e39415d99267397)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:39.839795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:39.888256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:39.959986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90565f2228a44f02a927d42096960eed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.961457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90565f2228a44f02a927d42096960eed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:39.979142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90565f2228a44f02a927d42096960eed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.071527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb26c59ceea414a8e39415d99267397', 'request_id': 'req-e59d7946-0f2b-48cf-9a7f-d006322a99da'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.078513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb26c59ceea414a8e39415d99267397', 'request_id': 'req-e59d7946-0f2b-48cf-9a7f-d006322a99da'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.081858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90565f2228a44f02a927d42096960eed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.085270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90565f2228a44f02a927d42096960eed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.117264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1032/2043] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:39 2022] DELETE /identity/v3/users/90565f2228a44f02a927d42096960eed => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:40.226113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb26c59ceea414a8e39415d99267397', 'request_id': 'req-e59d7946-0f2b-48cf-9a7f-d006322a99da'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.249686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] The token cache is being invalidate because project ceb26c59ceea414a8e39415d99267397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:40.250269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.251587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.254340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1012/2044] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:39 2022] DELETE /identity/v3/projects/ceb26c59ceea414a8e39415d99267397 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:40.258713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:40.260194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:40.353105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:40.356297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359521b3-6261-4f3f-99a2-99148a328280 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:40.364497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:40.365256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:40.365587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:40.365867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] PATH_INFO: `/v3/users/a91ace6eb9474f3bbefb0133b107cb32` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:40.367150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91ace6eb9474f3bbefb0133b107cb32)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:40.369228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:40.593912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91ace6eb9474f3bbefb0133b107cb32'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.595495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91ace6eb9474f3bbefb0133b107cb32'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.601451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:40.602883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:40.618193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91ace6eb9474f3bbefb0133b107cb32'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.683144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91ace6eb9474f3bbefb0133b107cb32'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.683957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91ace6eb9474f3bbefb0133b107cb32'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:40.698915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1033/2045] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:40 2022] DELETE /identity/v3/users/a91ace6eb9474f3bbefb0133b107cb32 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:40.709826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d7946-0f2b-48cf-9a7f-d006322a99da admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:40.750458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:40.751932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:40.790610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:40.791266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:40.791629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:40.791905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] PATH_INFO: `/v3/users/a2b1f29c3a20499ea9ecbbd9dfcbd231` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:40.793044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b1f29c3a20499ea9ecbbd9dfcbd231)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:40.810227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:40.860450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce46e0-6827-4d52-b538-13a38144d223 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:40.865663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:40.866295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:40.866573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:40.866844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] PATH_INFO: `/v3/projects/455aec56628e4d5c8a10ddf355ca0e8e` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:40.867978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=455aec56628e4d5c8a10ddf355ca0e8e)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:40.869982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.049454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455aec56628e4d5c8a10ddf355ca0e8e', 'request_id': 'req-6286d438-17c6-4836-bd29-9c103b8b2850'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.053044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b1f29c3a20499ea9ecbbd9dfcbd231'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.054462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b1f29c3a20499ea9ecbbd9dfcbd231'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.058454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455aec56628e4d5c8a10ddf355ca0e8e', 'request_id': 'req-6286d438-17c6-4836-bd29-9c103b8b2850'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.070906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b1f29c3a20499ea9ecbbd9dfcbd231'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.104805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455aec56628e4d5c8a10ddf355ca0e8e', 'request_id': 'req-6286d438-17c6-4836-bd29-9c103b8b2850'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.122542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] The token cache is being invalidate because project 455aec56628e4d5c8a10ddf355ca0e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:41.123721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.124613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6286d438-17c6-4836-bd29-9c103b8b2850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.126230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1034/2046] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:40 2022] DELETE /identity/v3/projects/455aec56628e4d5c8a10ddf355ca0e8e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:41.131667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992605-3e43-43bc-b4b5-afd256bb5240 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.132127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992605-3e43-43bc-b4b5-afd256bb5240 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.132403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1992605-3e43-43bc-b4b5-afd256bb5240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.139366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:41.154473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a1992605-3e43-43bc-b4b5-afd256bb5240 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:41.154895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a1992605-3e43-43bc-b4b5-afd256bb5240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.196614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b1f29c3a20499ea9ecbbd9dfcbd231'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.197693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b1f29c3a20499ea9ecbbd9dfcbd231'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.217474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1013/2047] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:40 2022] DELETE /identity/v3/users/a2b1f29c3a20499ea9ecbbd9dfcbd231 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:41.218667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.220330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.228017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1035/2048] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:41.241383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6062-8181-4206-bb81-cfd65f05eb65 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.241756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6062-8181-4206-bb81-cfd65f05eb65 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.242792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e6062-8181-4206-bb81-cfd65f05eb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.280074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-932e6062-8181-4206-bb81-cfd65f05eb65 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:41.281347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-932e6062-8181-4206-bb81-cfd65f05eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.341560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e12-0791-4ac3-b5e9-c3c056e96148 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.348979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.350062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.350488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.350765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] PATH_INFO: `/v3/projects/e9a8269c943d4694bb68fc4f066a1256` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.352575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a8269c943d4694bb68fc4f066a1256)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.355266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.372658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1036/2049] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:41.373688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e6062-8181-4206-bb81-cfd65f05eb65 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.385216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e6062-8181-4206-bb81-cfd65f05eb65 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.390250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.391225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.391597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.392032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.392985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:41.393356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.395137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.413299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1037/2050] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:41.413299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.431012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc68b-1d49-4fbc-8fd4-e86057639c5b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.436721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.437331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.437611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.437884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.438515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.443513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.483218 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a8269c943d4694bb68fc4f066a1256', 'request_id': 'req-60b85e87-e031-4d7f-8930-b22cdbbbe47c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.490324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a8269c943d4694bb68fc4f066a1256', 'request_id': 'req-60b85e87-e031-4d7f-8930-b22cdbbbe47c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.572801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1038/2051] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:41 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:41.572801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.574378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.579162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a8269c943d4694bb68fc4f066a1256', 'request_id': 'req-60b85e87-e031-4d7f-8930-b22cdbbbe47c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.596301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] The token cache is being invalidate because project e9a8269c943d4694bb68fc4f066a1256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:41.596301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.596301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.596785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1014/2052] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:41 2022] DELETE /identity/v3/projects/e9a8269c943d4694bb68fc4f066a1256 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:41.597767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.599632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.649832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e407db-a71d-420b-b0de-b98408a61b7a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.654858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.655574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.655816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.656099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] PATH_INFO: `/v3/projects/ae16959df7324632a105f8284f095311` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.657225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae16959df7324632a105f8284f095311)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.659168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.674303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b85e87-e031-4d7f-8930-b22cdbbbe47c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.680010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddd0cb-aaf6-4b90-be11-0753c7bd243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.681291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd0cb-aaf6-4b90-be11-0753c7bd243a admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.681291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd0cb-aaf6-4b90-be11-0753c7bd243a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.683192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd0cb-aaf6-4b90-be11-0753c7bd243a admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.683192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddd0cb-aaf6-4b90-be11-0753c7bd243a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.684261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddd0cb-aaf6-4b90-be11-0753c7bd243a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.753718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1015/2053] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:41 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:41.756365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02c89a-6759-468b-9c75-047c363e538f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.756655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02c89a-6759-468b-9c75-047c363e538f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.758785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02c89a-6759-468b-9c75-047c363e538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.781015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae16959df7324632a105f8284f095311', 'request_id': 'req-4665c245-40b0-4e71-8472-d61f3db52f87'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.784209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ff02c89a-6759-468b-9c75-047c363e538f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:41.785503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ff02c89a-6759-468b-9c75-047c363e538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.791625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae16959df7324632a105f8284f095311', 'request_id': 'req-4665c245-40b0-4e71-8472-d61f3db52f87'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.864379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1016/2054] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:41.865467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02c89a-6759-468b-9c75-047c363e538f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.883310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02c89a-6759-468b-9c75-047c363e538f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.889874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31612fd5-a27e-47a7-b77d-98ad060b7334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.890509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612fd5-a27e-47a7-b77d-98ad060b7334 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.890789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612fd5-a27e-47a7-b77d-98ad060b7334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.891061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612fd5-a27e-47a7-b77d-98ad060b7334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.891801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612fd5-a27e-47a7-b77d-98ad060b7334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.893511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612fd5-a27e-47a7-b77d-98ad060b7334 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.906082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1017/2055] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:41.907414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86e70-2b6c-463e-8699-1e726b0ac5dc None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.907838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86e70-2b6c-463e-8699-1e726b0ac5dc None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.908126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e86e70-2b6c-463e-8699-1e726b0ac5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.910819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae16959df7324632a105f8284f095311', 'request_id': 'req-4665c245-40b0-4e71-8472-d61f3db52f87'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.929635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] The token cache is being invalidate because project ae16959df7324632a105f8284f095311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:41.929635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.929635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:41.930595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-54e86e70-2b6c-463e-8699-1e726b0ac5dc None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:41.930755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1039/2056] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:41 2022] DELETE /identity/v3/projects/ae16959df7324632a105f8284f095311 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:41.931016 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.932235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.932415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-54e86e70-2b6c-463e-8699-1e726b0ac5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.940690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1018/2057] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:41.942453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797627ae-17c2-4298-a90d-545335cad0b8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.943056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797627ae-17c2-4298-a90d-545335cad0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.943269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797627ae-17c2-4298-a90d-545335cad0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.948302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665c245-40b0-4e71-8472-d61f3db52f87 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.953060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.953734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.954081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.954442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.955222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.956912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.963304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-797627ae-17c2-4298-a90d-545335cad0b8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:41.964519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-797627ae-17c2-4298-a90d-545335cad0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:41.967703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1040/2058] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:41.971879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.974189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1019/2059] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:41.975107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797627ae-17c2-4298-a90d-545335cad0b8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:41.981583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048cad-244a-47f0-b98c-d2420769834d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.986244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01951e95-5e6b-47b5-8897-d9444926ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.986835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01951e95-5e6b-47b5-8897-d9444926ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.987118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01951e95-5e6b-47b5-8897-d9444926ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.987392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01951e95-5e6b-47b5-8897-d9444926ef71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:41.988067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01951e95-5e6b-47b5-8897-d9444926ef71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:41.988369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01951e95-5e6b-47b5-8897-d9444926ef71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:41.990487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01951e95-5e6b-47b5-8897-d9444926ef71 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:41.991040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797627ae-17c2-4298-a90d-545335cad0b8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:41.995946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:41.996678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:41.997019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:41.997296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] PATH_INFO: `/v3/projects/f07ddfaeac0345989a5574df9eb9c0c0/users/57b6a589728b4a8db8431fd6fbf52886/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.011987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1041/2060] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:42.011987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a4ef-923b-4538-a67b-1c2c2d627f88 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.011987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a4ef-923b-4538-a67b-1c2c2d627f88 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.011987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a4ef-923b-4538-a67b-1c2c2d627f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.013514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07ddfaeac0345989a5574df9eb9c0c0, user_id=57b6a589728b4a8db8431fd6fbf52886, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.016238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.030106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-57e7a4ef-923b-4538-a67b-1c2c2d627f88 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:42.032884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-57e7a4ef-923b-4538-a67b-1c2c2d627f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:42.040480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1042/2061] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:42.041133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7a4ef-923b-4538-a67b-1c2c2d627f88 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.050485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7a4ef-923b-4538-a67b-1c2c2d627f88 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.055891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe76d3-f355-46bd-8d2c-ba5cab71facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.056483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe76d3-f355-46bd-8d2c-ba5cab71facb admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.056761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe76d3-f355-46bd-8d2c-ba5cab71facb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.057032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe76d3-f355-46bd-8d2c-ba5cab71facb admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.057682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe76d3-f355-46bd-8d2c-ba5cab71facb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.059701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe76d3-f355-46bd-8d2c-ba5cab71facb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.151088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1020/2062] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:41 2022] PUT /identity/v3/projects/f07ddfaeac0345989a5574df9eb9c0c0/users/57b6a589728b4a8db8431fd6fbf52886/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:42.151882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.184598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1043/2063] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:42.184598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81142c-72f6-457f-bc94-8b8c9f40acf8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.184598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81142c-72f6-457f-bc94-8b8c9f40acf8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.184598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81142c-72f6-457f-bc94-8b8c9f40acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.214402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4c81142c-72f6-457f-bc94-8b8c9f40acf8 None None] MFA Rules not processed for user `57b6a589728b4a8db8431fd6fbf52886`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:42.215699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4c81142c-72f6-457f-bc94-8b8c9f40acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:42.221320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871dd5b-9f03-4c76-a1f1-424f8afca60e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.277851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.278592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.278952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.279321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.280000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:42.280304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.281950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.282693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1044/2064] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:42.283261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81142c-72f6-457f-bc94-8b8c9f40acf8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.294729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81142c-72f6-457f-bc94-8b8c9f40acf8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.296990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1021/2065] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:42.297711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.302423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.303027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.303302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.303600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.304230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.306145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.309674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba94b84-eef0-419d-a7bb-920086823e5d admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.314308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.314833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.315115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.315490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.316119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.318655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.419089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1045/2066] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:42.419998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.430040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180c72b-9e89-4f25-934b-066df062f399 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.434853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.435456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.435742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.436015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.436641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.438532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.459780 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:42.465626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1022/2067] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:42.465626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.525306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69529ae9-de6a-4928-ab50-b5851af2be87 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.530438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.531053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.531337 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.531636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.532533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.534131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.544962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1023/2068] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:42.545905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.556167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d038116-d29b-4c86-9f9e-5213a2e06928 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.560840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.561463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.561745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.562049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.562680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.564617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.586324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1046/2069] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:42.587165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.648767 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723cd30-bcf1-4cf5-a0af-2661ce6c1630 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.656253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1024/2070] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:42.656435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.656435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.656435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.657034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.657124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.657124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.657124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.665439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd86133-309a-477f-a324-4319f545f239 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.668736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1047/2071] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:42.670502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.671133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.671505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.671981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.672544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.672642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.674797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.683204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3efcc-f8c4-4217-8cd8-a3e80f41cba7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.687984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.688567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.688843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.689112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.689744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.691309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.701291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1048/2072] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:42.702187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.711680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79774ce8-4c4d-4aa1-bf83-b10f7d19a41b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.716477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.716611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:42.717088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.717365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.717637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] PATH_INFO: `/v3/projects/797ef7254718453288a8c6333383e3a1/users/68683bcfd966461b9c53bad3db48f6c1/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.732543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=797ef7254718453288a8c6333383e3a1, user_id=68683bcfd966461b9c53bad3db48f6c1, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.735145 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.819769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1025/2073] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:42.820734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.830774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13fdb6-a4b5-4f76-b0a8-4b19106765a7 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.831026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1049/2074] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:42 2022] PUT /identity/v3/projects/797ef7254718453288a8c6333383e3a1/users/68683bcfd966461b9c53bad3db48f6c1/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:42.840452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:42.907077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ced290-7b14-4bb9-ac89-e0233016b6ca admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:42.908045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.908829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.909118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.909400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] PATH_INFO: `/v3/projects/21c4573b0f5b4c0c9cc9214abbc76e60/users/af6a52a14826408098da88b8a02c73d5/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.913059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9eb46-4855-41e1-b27f-7eddac0e4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:42.913573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9eb46-4855-41e1-b27f-7eddac0e4f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.913858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9eb46-4855-41e1-b27f-7eddac0e4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.914842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9eb46-4855-41e1-b27f-7eddac0e4f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.914842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9eb46-4855-41e1-b27f-7eddac0e4f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.916436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9eb46-4855-41e1-b27f-7eddac0e4f90 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.930837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c4573b0f5b4c0c9cc9214abbc76e60, user_id=af6a52a14826408098da88b8a02c73d5, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:42.933883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:42.936494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1050/2075] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:42.939297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891abb-ce80-4f81-9957-ea32450241d0 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:42.939711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891abb-ce80-4f81-9957-ea32450241d0 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:42.940199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a891abb-ce80-4f81-9957-ea32450241d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:42.974860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4a891abb-ce80-4f81-9957-ea32450241d0 None None] MFA Rules not processed for user `68683bcfd966461b9c53bad3db48f6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:42.976111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4a891abb-ce80-4f81-9957-ea32450241d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:43.043153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1051/2076] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:43.044117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891abb-ce80-4f81-9957-ea32450241d0 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.055052 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a891abb-ce80-4f81-9957-ea32450241d0 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.060034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.060643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.060923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.061194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.061840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.063493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.077244 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1052/2077] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:43.080996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1026/2078] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:42 2022] PUT /identity/v3/projects/21c4573b0f5b4c0c9cc9214abbc76e60/users/af6a52a14826408098da88b8a02c73d5/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:43.084641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.085939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.101800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4173c-796a-4df2-9cf8-c01758bc45a7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.160958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26602ca-137a-4d7a-9019-b66d4c266966 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.163849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.173962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.173962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.173962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.173962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.174642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.174735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.174807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.174807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.174807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] PATH_INFO: `/v3/projects/c177b52ac3474620b411870ef03affe1/users/24ae810cf4bf4014bc455d4653eb77f8/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.179814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1053/2079] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:43.180599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.182411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:43.198637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c177b52ac3474620b411870ef03affe1, user_id=24ae810cf4bf4014bc455d4653eb77f8, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.198637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.245254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9a51f-4628-4d5a-b001-64fb068d057b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.249055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde273-40db-482c-99c5-ccb1b536c0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.249747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde273-40db-482c-99c5-ccb1b536c0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.250100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde273-40db-482c-99c5-ccb1b536c0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.250434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde273-40db-482c-99c5-ccb1b536c0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.308661 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde273-40db-482c-99c5-ccb1b536c0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.310384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcde273-40db-482c-99c5-ccb1b536c0f7 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.315919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1027/2080] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:43 2022] PUT /identity/v3/projects/c177b52ac3474620b411870ef03affe1/users/24ae810cf4bf4014bc455d4653eb77f8/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:43.319645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.320226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1054/2081] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:43.321512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56bd7-7eae-4877-9c34-75feb569a3dd None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.321748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56bd7-7eae-4877-9c34-75feb569a3dd None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.322021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d56bd7-7eae-4877-9c34-75feb569a3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.344524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b0d56bd7-7eae-4877-9c34-75feb569a3dd None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:43.345738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b0d56bd7-7eae-4877-9c34-75feb569a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:43.384569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4b9f0-d48d-4292-8d36-93c54f785973 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.389628 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.390368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.390653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.390934 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] PATH_INFO: `/v3/projects/21c4573b0f5b4c0c9cc9214abbc76e60/users/af6a52a14826408098da88b8a02c73d5/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.392890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c4573b0f5b4c0c9cc9214abbc76e60, user_id=af6a52a14826408098da88b8a02c73d5, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.396146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.406016 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1055/2082] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:43.406810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56bd7-7eae-4877-9c34-75feb569a3dd None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.406938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1028/2083] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:43 2022] PUT /identity/v3/projects/21c4573b0f5b4c0c9cc9214abbc76e60/users/af6a52a14826408098da88b8a02c73d5/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:43.416578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.418271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:43.422168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d56bd7-7eae-4877-9c34-75feb569a3dd None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.480317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.481011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.481294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.481383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933587d3-9c24-4baf-b341-e4bc8c637779 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.481565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] PATH_INFO: `/v3/users/68683bcfd966461b9c53bad3db48f6c1` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.482685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68683bcfd966461b9c53bad3db48f6c1)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.484718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.485529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11492dd0-b1b7-4c98-96f0-2624a467d664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.486192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11492dd0-b1b7-4c98-96f0-2624a467d664 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.486476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11492dd0-b1b7-4c98-96f0-2624a467d664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.486751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11492dd0-b1b7-4c98-96f0-2624a467d664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.497484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11492dd0-b1b7-4c98-96f0-2624a467d664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.498909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11492dd0-b1b7-4c98-96f0-2624a467d664 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.509339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1029/2084] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:43.510646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2cad9-8383-4ae3-9313-3217224e8997 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.510930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2cad9-8383-4ae3-9313-3217224e8997 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.511597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2cad9-8383-4ae3-9313-3217224e8997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.539862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-06b2cad9-8383-4ae3-9313-3217224e8997 None None] MFA Rules not processed for user `af6a52a14826408098da88b8a02c73d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:43.541068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-06b2cad9-8383-4ae3-9313-3217224e8997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:43.606470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1030/2085] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:43.617614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2cad9-8383-4ae3-9313-3217224e8997 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:43.631761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:43.687864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2cad9-8383-4ae3-9313-3217224e8997 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:43.692005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6682e-caf4-455a-b4c5-f3a11602e1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:43.692624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6682e-caf4-455a-b4c5-f3a11602e1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.692906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6682e-caf4-455a-b4c5-f3a11602e1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.693180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6682e-caf4-455a-b4c5-f3a11602e1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.752972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6682e-caf4-455a-b4c5-f3a11602e1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:43.754485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6682e-caf4-455a-b4c5-f3a11602e1b9 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:43.764567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68683bcfd966461b9c53bad3db48f6c1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:43.765238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1031/2086] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:43.765556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68683bcfd966461b9c53bad3db48f6c1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:43.779880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68683bcfd966461b9c53bad3db48f6c1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:43.871472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68683bcfd966461b9c53bad3db48f6c1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:43.872388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68683bcfd966461b9c53bad3db48f6c1'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:43.890998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1056/2087] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:43 2022] DELETE /identity/v3/users/68683bcfd966461b9c53bad3db48f6c1 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:43.896623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:43.896994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:43.897365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:43.919502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:43.925608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:43.990129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1032/2088] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:44.000043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:44.001468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:44.062153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888ab9-4141-4783-be5f-181030b2457d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:44.066121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc2382-aeef-4067-b788-5ed213776699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:44.067233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2382-aeef-4067-b788-5ed213776699 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:44.067684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2382-aeef-4067-b788-5ed213776699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:44.068045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2382-aeef-4067-b788-5ed213776699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:44.079637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc2382-aeef-4067-b788-5ed213776699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:44.081342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc2382-aeef-4067-b788-5ed213776699 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:44.092669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1057/2089] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:44.604184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:44.606700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:44.640634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f5a7e-4f31-4a4d-a657-1911ccac2299 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:44.646710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:44.647371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:44.647715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:44.647993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] PATH_INFO: `/v3/projects/797ef7254718453288a8c6333383e3a1` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:44.649144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=797ef7254718453288a8c6333383e3a1)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:44.651102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:44.760052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797ef7254718453288a8c6333383e3a1', 'request_id': 'req-b204d685-7f22-437f-bf09-6828604ef94a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:44.766308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797ef7254718453288a8c6333383e3a1', 'request_id': 'req-b204d685-7f22-437f-bf09-6828604ef94a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:44.875990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797ef7254718453288a8c6333383e3a1', 'request_id': 'req-b204d685-7f22-437f-bf09-6828604ef94a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:44.887555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] The token cache is being invalidate because project 797ef7254718453288a8c6333383e3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:44.894017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:44.894017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b204d685-7f22-437f-bf09-6828604ef94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:44.894017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1033/2090] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:44 2022] DELETE /identity/v3/projects/797ef7254718453288a8c6333383e3a1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:44.897691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315772a-1936-4f4f-9315-fe0b9350e1c8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:44.898177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315772a-1936-4f4f-9315-fe0b9350e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:44.898397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315772a-1936-4f4f-9315-fe0b9350e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:44.924771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4315772a-1936-4f4f-9315-fe0b9350e1c8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:44.926003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4315772a-1936-4f4f-9315-fe0b9350e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:44.992565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1058/2091] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:45.001241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7806f2-760a-4f17-8fdd-a6ad0009965f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.001463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7806f2-760a-4f17-8fdd-a6ad0009965f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.001745 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7806f2-760a-4f17-8fdd-a6ad0009965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.024838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ea7806f2-760a-4f17-8fdd-a6ad0009965f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:45.026169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ea7806f2-760a-4f17-8fdd-a6ad0009965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:45.035020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1034/2092] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:45.039763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315772a-1936-4f4f-9315-fe0b9350e1c8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.050782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315772a-1936-4f4f-9315-fe0b9350e1c8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.061419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:45.069165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:45.069798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.070084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.070356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.071384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:45.071725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:45.073691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:45.092119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1059/2093] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:45.097327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7806f2-760a-4f17-8fdd-a6ad0009965f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.107822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7806f2-760a-4f17-8fdd-a6ad0009965f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.113260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:45.114758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.114957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.115301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.115989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:45.118117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:45.215888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1035/2094] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:45 2022] POST /identity/v3/projects => generated 359 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:45.220048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.230575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653c40e-d2da-48ca-8686-a0b2d20b58e4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.293689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:45.294300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.294580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.294851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.295896 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:45.297914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:45.411933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1060/2095] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:45 2022] POST /identity/v3/users => generated 280 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:45.412975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.423650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6ec82-4b11-44c6-8e52-24f0830723b9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.430083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:45.430810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.431183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.431582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.432303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:45.434056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:45.445981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1036/2096] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:45.450114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.461381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7b112-6dd9-40e7-97e2-ab8ea0d12b44 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.466732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:45.467833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.471207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.471207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.471207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:45.474396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:45.486125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1061/2097] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:45.490431 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.503444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93514d-880c-4740-a18e-d22620d0539c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.510178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861076de-3bfd-4cb2-b535-82d109dae668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:45.510926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861076de-3bfd-4cb2-b535-82d109dae668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.511374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861076de-3bfd-4cb2-b535-82d109dae668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.511680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861076de-3bfd-4cb2-b535-82d109dae668 admin admin] PATH_INFO: `/v3/projects/b58102b0bebb4fd6ac8c83f843530f2f/users/9f80150b9d274a78bb6946f67ee5e50f/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.536524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861076de-3bfd-4cb2-b535-82d109dae668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58102b0bebb4fd6ac8c83f843530f2f, user_id=9f80150b9d274a78bb6946f67ee5e50f, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:45.539510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861076de-3bfd-4cb2-b535-82d109dae668 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:45.581455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.584036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:45.597712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1c4e3-77a8-436d-962d-301bc6984172 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.603281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:45.604183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.604460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.604816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] PATH_INFO: `/v3/users/79b088bd27a146adbfa73e7082be7e23` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.606021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b088bd27a146adbfa73e7082be7e23)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:45.608042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:45.654194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1037/2098] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:45 2022] PUT /identity/v3/projects/b58102b0bebb4fd6ac8c83f843530f2f/users/9f80150b9d274a78bb6946f67ee5e50f/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:45.664643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.665156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.665427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.696415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] MFA Rules not processed for user `9f80150b9d274a78bb6946f67ee5e50f`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:45.697658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:45.772522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1038/2099] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:45.832961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:45.834337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b088bd27a146adbfa73e7082be7e23'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:45.834766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:45.835137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b088bd27a146adbfa73e7082be7e23'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:45.869196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b088bd27a146adbfa73e7082be7e23'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:45.928116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b088bd27a146adbfa73e7082be7e23'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:45.928773 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-322fc982-8a8d-4599-a84b-523065a65617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b088bd27a146adbfa73e7082be7e23'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:45.947742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1062/2100] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:45 2022] DELETE /identity/v3/users/79b088bd27a146adbfa73e7082be7e23 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:45.952321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:45.952576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:45.953172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:45.970207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53757577-8ee3-477e-b18f-5891ec3ae464 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:45.987771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:45.991086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:46.055915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:46.056567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:46.056977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:46.057836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:46.060083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:46.106280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1063/2101] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:46.117402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:46.119216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:46.181491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:46.182961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:46.203395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07d87-f735-46a4-8581-9ea2202fcdf4 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:46.203932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:46.211881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1039/2102] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:46.212741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37fc02-eb07-4b35-bf36-bb1e08901941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:46.212741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37fc02-eb07-4b35-bf36-bb1e08901941 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:46.212741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37fc02-eb07-4b35-bf36-bb1e08901941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:46.212741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37fc02-eb07-4b35-bf36-bb1e08901941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:46.218665 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:46.220305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:46.226695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37fc02-eb07-4b35-bf36-bb1e08901941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:46.229230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37fc02-eb07-4b35-bf36-bb1e08901941 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:46.239530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a79f2-f9d2-41dd-b167-001ab65f1c07 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:46.243257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1064/2103] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:46.246976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:46.247678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:46.248139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:46.248422 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] PATH_INFO: `/v3/users/9f80150b9d274a78bb6946f67ee5e50f` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:46.249690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f80150b9d274a78bb6946f67ee5e50f)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:46.251715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:46.487320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f80150b9d274a78bb6946f67ee5e50f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:46.488249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f80150b9d274a78bb6946f67ee5e50f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:46.562990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f80150b9d274a78bb6946f67ee5e50f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:46.596980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:46.625481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f80150b9d274a78bb6946f67ee5e50f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:46.626124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f80150b9d274a78bb6946f67ee5e50f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:46.643678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1040/2104] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:46 2022] DELETE /identity/v3/users/9f80150b9d274a78bb6946f67ee5e50f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:46.650334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:46.650334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:46.650334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:46.676706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:46.678333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:46.764002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:46.765563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:46.777469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1065/2105] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:46.790390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:46.792181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:46.865780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b63d-8af6-44c5-8339-3bcc9f04609c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:46.879702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:46.880596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:46.880962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:46.881314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] PATH_INFO: `/v3/projects/ed757a2c7eeb4c36bb1f6b4b6fec0eae` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:46.882619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed757a2c7eeb4c36bb1f6b4b6fec0eae)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:46.884657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:46.888457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad946425-5a18-4044-ae52-b8588ca179c5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:46.896463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a94ef8-f4c1-4734-b0f7-df001cb4f42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:46.897108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94ef8-f4c1-4734-b0f7-df001cb4f42f service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:46.897754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94ef8-f4c1-4734-b0f7-df001cb4f42f service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:46.898043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a94ef8-f4c1-4734-b0f7-df001cb4f42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:46.918214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a94ef8-f4c1-4734-b0f7-df001cb4f42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:46.920616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a94ef8-f4c1-4734-b0f7-df001cb4f42f service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:46.939222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1066/2106] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:47.047816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed757a2c7eeb4c36bb1f6b4b6fec0eae', 'request_id': 'req-9c319704-8c5c-42df-97ee-8790d27b45e9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.057394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed757a2c7eeb4c36bb1f6b4b6fec0eae', 'request_id': 'req-9c319704-8c5c-42df-97ee-8790d27b45e9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.179512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed757a2c7eeb4c36bb1f6b4b6fec0eae', 'request_id': 'req-9c319704-8c5c-42df-97ee-8790d27b45e9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.195952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] The token cache is being invalidate because project ed757a2c7eeb4c36bb1f6b4b6fec0eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:47.197273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.198189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9c319704-8c5c-42df-97ee-8790d27b45e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.200522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1041/2107] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:46 2022] DELETE /identity/v3/projects/ed757a2c7eeb4c36bb1f6b4b6fec0eae => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:47.205795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b746-890d-46b6-b876-431ec9622a6c None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.206368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b746-890d-46b6-b876-431ec9622a6c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.206853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b746-890d-46b6-b876-431ec9622a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.254990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-af52b746-890d-46b6-b876-431ec9622a6c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:47.254990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-af52b746-890d-46b6-b876-431ec9622a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:47.327849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1067/2108] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:47.337197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6838cf-bc45-4c79-8ba2-d5833d62dbbb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.337489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6838cf-bc45-4c79-8ba2-d5833d62dbbb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.337771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6838cf-bc45-4c79-8ba2-d5833d62dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.362254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-fd6838cf-bc45-4c79-8ba2-d5833d62dbbb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:47.364730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fd6838cf-bc45-4c79-8ba2-d5833d62dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:47.376869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1042/2109] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:47.381808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52b746-890d-46b6-b876-431ec9622a6c None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:47.392997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52b746-890d-46b6-b876-431ec9622a6c None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:47.400998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:47.401632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.401916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.402195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.402869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:47.403584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:47.404895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:47.450158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6838cf-bc45-4c79-8ba2-d5833d62dbbb None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:47.453546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1068/2110] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:47.465213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6838cf-bc45-4c79-8ba2-d5833d62dbbb None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:47.471316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:47.472119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.472406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.472731 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.473546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:47.475710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:47.513841 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:47.515821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:47.532854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edeef7-82e7-4915-b6c8-1fc64ab9b469 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:47.539694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:47.543457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.543457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.543457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] PATH_INFO: `/v3/projects/b58102b0bebb4fd6ac8c83f843530f2f` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.543457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58102b0bebb4fd6ac8c83f843530f2f)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:47.548471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:47.630426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1043/2111] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:47 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:47.631688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:47.691885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58102b0bebb4fd6ac8c83f843530f2f', 'request_id': 'req-8de57e02-df97-46fd-9a01-088c50463a93'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.700478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58102b0bebb4fd6ac8c83f843530f2f', 'request_id': 'req-8de57e02-df97-46fd-9a01-088c50463a93'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.717303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b6e42-0be8-438d-835f-c5a226b54687 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:47.810834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:47.812779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.812779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.812779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.814242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:47.817043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:47.832916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58102b0bebb4fd6ac8c83f843530f2f', 'request_id': 'req-8de57e02-df97-46fd-9a01-088c50463a93'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.856952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] The token cache is being invalidate because project b58102b0bebb4fd6ac8c83f843530f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:47.857589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.858444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8de57e02-df97-46fd-9a01-088c50463a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:47.860304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1069/2112] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:47 2022] DELETE /identity/v3/projects/b58102b0bebb4fd6ac8c83f843530f2f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:47.865540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c60562-781a-4272-bb02-44c343936c6c None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.865829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c60562-781a-4272-bb02-44c343936c6c None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.866092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c60562-781a-4272-bb02-44c343936c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.888365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b1c60562-781a-4272-bb02-44c343936c6c None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:47.889509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b1c60562-781a-4272-bb02-44c343936c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:47.906378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1070/2113] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:47.908846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a81007-7544-4915-b370-bacfff020168 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.909157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a81007-7544-4915-b370-bacfff020168 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.909406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a81007-7544-4915-b370-bacfff020168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.925791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1044/2114] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:47 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:47.931993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:47.933983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:47.948105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-59a81007-7544-4915-b370-bacfff020168 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:47.950139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-59a81007-7544-4915-b370-bacfff020168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:47.951889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fe700-a844-4036-9635-9871c5beb071 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:47.963801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1071/2115] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:47.966392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a81007-7544-4915-b370-bacfff020168 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:47.968895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:47.969528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.969811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.970087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.970997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:47.972616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:47.981104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a81007-7544-4915-b370-bacfff020168 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:47.987214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:47.989109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:47.989109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:47.989109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:47.989982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:47.990295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:47.992945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:47.999479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1045/2116] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:48.000549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.019254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10168dc0-7401-4931-a850-3ae096d3ead7 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.025756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1072/2117] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:48.030167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.038259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.038888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.039166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.041260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.052447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.053729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ce708-c409-4990-97fd-f55b2c504e41 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.056710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.061478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.062366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.062996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.063654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.064485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.067218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.085988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1046/2118] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:48.087073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.107073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e40b8-c721-4763-803d-15d54bc902cb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.113247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb9b77-2111-498a-8af2-40618d71cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.114626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb9b77-2111-498a-8af2-40618d71cd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.114968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb9b77-2111-498a-8af2-40618d71cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.115306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb9b77-2111-498a-8af2-40618d71cd9b admin admin] PATH_INFO: `/v3/projects/8a37a3f685a24e3ca3b0ac1b864aa0f0/users/33eafdd0753c43bb95584a2c6e578407/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.128152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:48.135813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb9b77-2111-498a-8af2-40618d71cd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a37a3f685a24e3ca3b0ac1b864aa0f0, user_id=33eafdd0753c43bb95584a2c6e578407, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.138763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb9b77-2111-498a-8af2-40618d71cd9b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.165980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1073/2119] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:48 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:48.179325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.270763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1047/2120] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:48 2022] PUT /identity/v3/projects/8a37a3f685a24e3ca3b0ac1b864aa0f0/users/33eafdd0753c43bb95584a2c6e578407/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:48.273880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.274174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.274498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.284806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d321609-be8e-4f32-8360-9750d54f755c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.310114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:48.322840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:48.325475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:48.404963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.406204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.406630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.406913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.407590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.409732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.438970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1048/2121] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:48.464778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.466451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:48.527367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858176-6d7b-48fa-b843-b3462c6da299 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.539453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1074/2122] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:48 2022] POST /identity/v3/users => generated 287 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:48.544108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.544843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.549309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.549826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.550287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.558620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c8840-d91c-4b3a-91c1-6c7d6e9afeec admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.569403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.572968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.577662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.578634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.579267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.579267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.579953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.585116 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.595939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1049/2123] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:50:48.607675 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1075/2124] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:48.613970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.621293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ce729-1ceb-4202-ac3a-155e36eb1b70 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.630409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ab9ae-b9fc-4404-b477-2a37a4a990bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.632425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ab9ae-b9fc-4404-b477-2a37a4a990bb admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.636333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ab9ae-b9fc-4404-b477-2a37a4a990bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.636333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ab9ae-b9fc-4404-b477-2a37a4a990bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.636333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ab9ae-b9fc-4404-b477-2a37a4a990bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.636333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ab9ae-b9fc-4404-b477-2a37a4a990bb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.663465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1050/2125] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:48.665795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.677378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db471b1-839d-409c-a359-96a51be5f7e3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:48.684645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:48.685427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.685903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.686253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] PATH_INFO: `/v3/projects/2f0ffa6ba2124735a8b12131f1001511/users/696d5fdf3bae4dd5b33aa4bec27e87b6/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.706524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0ffa6ba2124735a8b12131f1001511, user_id=696d5fdf3bae4dd5b33aa4bec27e87b6, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:48.710936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:48.814515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1076/2126] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:48 2022] PUT /identity/v3/projects/2f0ffa6ba2124735a8b12131f1001511/users/696d5fdf3bae4dd5b33aa4bec27e87b6/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:48.820312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:48.820723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:48.820884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:48.842092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:48.843604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:48.912885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1051/2127] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:48.927898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:48.930132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:48.996479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7902c6-bce6-42df-b064-530876509eb1 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:49.007899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6e167-a43a-4c0e-b22f-d1e177950c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:49.008285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6e167-a43a-4c0e-b22f-d1e177950c59 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:49.008564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6e167-a43a-4c0e-b22f-d1e177950c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:49.008816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6e167-a43a-4c0e-b22f-d1e177950c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:49.019183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6e167-a43a-4c0e-b22f-d1e177950c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:49.020977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6e167-a43a-4c0e-b22f-d1e177950c59 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:49.032907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1077/2128] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:49.866532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:49.868825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:49.974329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:50.001517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5358e-a3a3-4682-acd6-67ab098224fa None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:50.012228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:50.012228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:50.012228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:50.012228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:50.012612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:50.112988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:50.130286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:50.144304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1052/2129] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:50.334023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:51.104954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c22b-9453-4fdc-b4e8-c0448cfb9d56 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:51.105924 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c22b-9453-4fdc-b4e8-c0448cfb9d56 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:51.106400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2c22b-9453-4fdc-b4e8-c0448cfb9d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:51.164647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-7df2c22b-9453-4fdc-b4e8-c0448cfb9d56 None None] MFA Rules not processed for user `24ae810cf4bf4014bc455d4653eb77f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:51.166303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7df2c22b-9453-4fdc-b4e8-c0448cfb9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:51.293814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1078/2130] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:51.308459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:51.310617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:51.394377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e950b15-d888-467c-a344-72ef5b832353 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:51.401773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:51.402671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:51.403139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:51.403626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:51.416645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:51.418703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:51.433338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1053/2131] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:51.693533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:51.695092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:51.695669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:51.795451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] MFA Rules not processed for user `696d5fdf3bae4dd5b33aa4bec27e87b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:51.795451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:51.999015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1079/2132] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:52.032371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:52.042896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879957f-8239-4d09-8519-35ec41c90929 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:52.046600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c351b12-93b1-4511-a04a-4c9183133764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:52.047462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351b12-93b1-4511-a04a-4c9183133764 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:52.047749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351b12-93b1-4511-a04a-4c9183133764 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:52.048023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351b12-93b1-4511-a04a-4c9183133764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:52.064107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c351b12-93b1-4511-a04a-4c9183133764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:52.065781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c351b12-93b1-4511-a04a-4c9183133764 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:52.092249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1054/2133] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:52.779249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:53.339527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:53.742133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:53.752627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:53.795303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f79ec-0bda-41f3-bd5a-163be2c8b138 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:53.809220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:53.810234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:53.810687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:53.811263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] PATH_INFO: `/v3/users/6d5ebebff9e7467d9b8e176ce8294372` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:53.813064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5ebebff9e7467d9b8e176ce8294372)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:53.817735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:54.166232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5ebebff9e7467d9b8e176ce8294372'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:54.167338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5ebebff9e7467d9b8e176ce8294372'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:54.193474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5ebebff9e7467d9b8e176ce8294372'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:54.298668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5ebebff9e7467d9b8e176ce8294372'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:54.300179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5ebebff9e7467d9b8e176ce8294372'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:54.323120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1080/2134] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:53 2022] DELETE /identity/v3/users/6d5ebebff9e7467d9b8e176ce8294372 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:54.327535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9716f6-8b4d-4b79-bfc6-460b06c72c89 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:54.333871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9716f6-8b4d-4b79-bfc6-460b06c72c89 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:54.333871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9716f6-8b4d-4b79-bfc6-460b06c72c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:54.357947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8b9716f6-8b4d-4b79-bfc6-460b06c72c89 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:54.360177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8b9716f6-8b4d-4b79-bfc6-460b06c72c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:54.493384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1055/2135] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:54.503146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:54.505425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:54.647655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d282318-0926-415d-87c6-4495b9390950 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:54.653621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a7c2-4ee5-4206-93f4-963a0d2c3216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:54.654391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a7c2-4ee5-4206-93f4-963a0d2c3216 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:54.654741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a7c2-4ee5-4206-93f4-963a0d2c3216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:54.655083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a7c2-4ee5-4206-93f4-963a0d2c3216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:54.678085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a7c2-4ee5-4206-93f4-963a0d2c3216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:54.679743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a7c2-4ee5-4206-93f4-963a0d2c3216 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:54.692915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1081/2136] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:54.777936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:54.778534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:54.778963 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:54.801958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] MFA Rules not processed for user `696d5fdf3bae4dd5b33aa4bec27e87b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:54.803597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:54.984318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1056/2137] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:50:56.094880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9e100-7870-4917-b580-b343a129d0db None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:56.095755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9e100-7870-4917-b580-b343a129d0db None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:56.095755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9e100-7870-4917-b580-b343a129d0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:56.122513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a4d9e100-7870-4917-b580-b343a129d0db None None] MFA Rules not processed for user `24ae810cf4bf4014bc455d4653eb77f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:56.124049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a4d9e100-7870-4917-b580-b343a129d0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:56.147638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:56.149706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:56.193417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2bc0-1dcf-48e3-871e-3b6d04098a15 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:56.227106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:56.230479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:56.234068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:56.234068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] PATH_INFO: `/v3/projects/69fad2a190444b58b3fb6fd5ee779a5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:56.236289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fad2a190444b58b3fb6fd5ee779a5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:56.242502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:56.257340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:56.323477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1082/2138] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:56.482900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fad2a190444b58b3fb6fd5ee779a5c', 'request_id': 'req-d71ef5b2-3961-484b-8d6e-4548e4571089'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:56.503000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fad2a190444b58b3fb6fd5ee779a5c', 'request_id': 'req-d71ef5b2-3961-484b-8d6e-4548e4571089'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:56.574241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fad2a190444b58b3fb6fd5ee779a5c', 'request_id': 'req-d71ef5b2-3961-484b-8d6e-4548e4571089'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:56.595033 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] The token cache is being invalidate because project 69fad2a190444b58b3fb6fd5ee779a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:56.596716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:56.600285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:56.603041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1057/2139] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:56 2022] DELETE /identity/v3/projects/69fad2a190444b58b3fb6fd5ee779a5c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:56.609720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9e100-7870-4917-b580-b343a129d0db None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:56.627935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9e100-7870-4917-b580-b343a129d0db None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:56.679544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:56.766384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:56.771268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:56.771268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:56.771268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] PATH_INFO: `/v3/users/50a86eaa198e482e8bc8a06f4fdef4c4` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:56.771268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a86eaa198e482e8bc8a06f4fdef4c4)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:56.775562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:56.987764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a86eaa198e482e8bc8a06f4fdef4c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:56.989846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a86eaa198e482e8bc8a06f4fdef4c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:57.029830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a86eaa198e482e8bc8a06f4fdef4c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:57.150726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a86eaa198e482e8bc8a06f4fdef4c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:57.155411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3ee8975a-48d0-4729-a81b-c99bf07f6022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a86eaa198e482e8bc8a06f4fdef4c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:57.191522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1083/2140] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:56 2022] DELETE /identity/v3/users/50a86eaa198e482e8bc8a06f4fdef4c4 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:57.716764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:57.741747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:57.755503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:57.765710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef5b2-3961-484b-8d6e-4548e4571089 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:57.868824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:57.869496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:57.869783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:57.870061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] PATH_INFO: `/v3/users/57b6a589728b4a8db8431fd6fbf52886` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:57.871700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b6a589728b4a8db8431fd6fbf52886)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:57.873630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:58.032147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.032437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.032712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.072662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] MFA Rules not processed for user `33eafdd0753c43bb95584a2c6e578407`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:58.074189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.178796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1084/2141] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:58.183612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:58.185047 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.199855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c420867-fe85-4982-aaf9-fc55b0d53c69 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:58.204496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:58.205108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.205390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.208489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.212945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:58.216045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:58.231019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b6a589728b4a8db8431fd6fbf52886'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.231967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b6a589728b4a8db8431fd6fbf52886'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.256018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b6a589728b4a8db8431fd6fbf52886'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.308591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1085/2142] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:58 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:50:58.309930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:58.312652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.319289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b6a589728b4a8db8431fd6fbf52886'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.319289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:58.321527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b6a589728b4a8db8431fd6fbf52886'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.367304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1058/2143] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:57 2022] DELETE /identity/v3/users/57b6a589728b4a8db8431fd6fbf52886 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:58.368202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:58.370548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.427760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdfd39-7576-4694-952f-044c2263fd37 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:58.462002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593c5b7-d504-4816-a601-a5c36f739897 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:58.468476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c03a90-66b3-4f58-b539-301fa1968c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:58.469357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03a90-66b3-4f58-b539-301fa1968c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.469826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03a90-66b3-4f58-b539-301fa1968c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.470546 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c03a90-66b3-4f58-b539-301fa1968c7f admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.471373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c03a90-66b3-4f58-b539-301fa1968c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:58.474362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c03a90-66b3-4f58-b539-301fa1968c7f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:58.499916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:58.500571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.500851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.501125 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] PATH_INFO: `/v3/projects/7c15e4dfbe7b437687e207b58ffac177` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.502296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c15e4dfbe7b437687e207b58ffac177)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:58.504484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:58.621309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1059/2144] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:58 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:58.626270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61ac0-996d-4926-b84d-9c063ab4b79d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.626760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61ac0-996d-4926-b84d-9c063ab4b79d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.628323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61ac0-996d-4926-b84d-9c063ab4b79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.638752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c15e4dfbe7b437687e207b58ffac177', 'request_id': 'req-ad706e94-ee5f-4040-b1b7-feba6b2a173d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.647739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c15e4dfbe7b437687e207b58ffac177', 'request_id': 'req-ad706e94-ee5f-4040-b1b7-feba6b2a173d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.673554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7ee61ac0-996d-4926-b84d-9c063ab4b79d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:58.676276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7ee61ac0-996d-4926-b84d-9c063ab4b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.754287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1060/2145] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:58.755313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61ac0-996d-4926-b84d-9c063ab4b79d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:58.772217 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c15e4dfbe7b437687e207b58ffac177', 'request_id': 'req-ad706e94-ee5f-4040-b1b7-feba6b2a173d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.777577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61ac0-996d-4926-b84d-9c063ab4b79d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:58.785610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] The token cache is being invalidate because project 7c15e4dfbe7b437687e207b58ffac177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:58.785995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.786963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:58.788931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1086/2146] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:58 2022] DELETE /identity/v3/projects/7c15e4dfbe7b437687e207b58ffac177 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:58.789710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:58.794043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e67e3-204a-48c7-ba31-b8288d5c6480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:58.794518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e67e3-204a-48c7-ba31-b8288d5c6480 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.794845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e67e3-204a-48c7-ba31-b8288d5c6480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.795113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e67e3-204a-48c7-ba31-b8288d5c6480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.795873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.800229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e67e3-204a-48c7-ba31-b8288d5c6480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:58.800229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e67e3-204a-48c7-ba31-b8288d5c6480 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:58.823454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1061/2147] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:58.825915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.826459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.834813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.858430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:58.860211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.874169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1062/2148] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:58.875305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:58.887587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.896913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3452f-a75b-4efd-8e50-908e266ffc1a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:58.901851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad706e94-ee5f-4040-b1b7-feba6b2a173d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:58.902673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:58.903335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.903826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.904236 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] PATH_INFO: `/v3/projects/2584d3bfdd4c4c25892cef6024c13bc9/users/6b6f9b0e8991496c9d3f9060b893e0bf/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.914483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073e0b1-83d8-4126-8778-debf7d4d6819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:58.921462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e0b1-83d8-4126-8778-debf7d4d6819 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.921462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e0b1-83d8-4126-8778-debf7d4d6819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.921462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e0b1-83d8-4126-8778-debf7d4d6819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.923226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2584d3bfdd4c4c25892cef6024c13bc9, user_id=6b6f9b0e8991496c9d3f9060b893e0bf, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:58.926763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:58.932114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8073e0b1-83d8-4126-8778-debf7d4d6819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:58.950479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073e0b1-83d8-4126-8778-debf7d4d6819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:58.951732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073e0b1-83d8-4126-8778-debf7d4d6819 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:58.964713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1087/2149] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:50:58.965996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64e8d7-e150-4dfd-a062-c48724a51206 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:58.966344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64e8d7-e150-4dfd-a062-c48724a51206 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:58.966626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64e8d7-e150-4dfd-a062-c48724a51206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:58.992295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1a64e8d7-e150-4dfd-a062-c48724a51206 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:58.993621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1a64e8d7-e150-4dfd-a062-c48724a51206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:59.007847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1088/2150] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:50:59.013567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64e8d7-e150-4dfd-a062-c48724a51206 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.024053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64e8d7-e150-4dfd-a062-c48724a51206 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.036509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.036509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.036509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.036509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.036994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:50:59.036994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.036994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.051115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1089/2151] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:50:59.055386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.070026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7117611-97c0-404a-8b11-82ee242c3cfa admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.076904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.088064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.088064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.088064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.088064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.088064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.091938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1063/2152] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:58 2022] PUT /identity/v3/projects/2584d3bfdd4c4c25892cef6024c13bc9/users/6b6f9b0e8991496c9d3f9060b893e0bf/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:59.096917 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.183471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180f1d0-a121-4861-b35a-c88c97ce87aa admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.188236 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.188867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.189151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.189425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.190075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.192301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.202781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1064/2153] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:59.207702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.225499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5956ae-a235-49ae-8dec-72a4dcbc49b1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.228959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1090/2154] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:50:59 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:59.234754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.320280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:59.341350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.342045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.342329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.342602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] PATH_INFO: `/v3/projects/2584d3bfdd4c4c25892cef6024c13bc9/users/6b6f9b0e8991496c9d3f9060b893e0bf/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.346221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2584d3bfdd4c4c25892cef6024c13bc9, user_id=6b6f9b0e8991496c9d3f9060b893e0bf, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.352293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.391511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1065/2155] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:59 2022] PUT /identity/v3/projects/2584d3bfdd4c4c25892cef6024c13bc9/users/6b6f9b0e8991496c9d3f9060b893e0bf/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:59.395941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e600cd3-32f4-4451-ad18-f7dc350c4cf6 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.463335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.463979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.464257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.464530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.465167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.467183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.562054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1091/2156] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:50:59 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:50:59.562828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.564594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:59.570821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.579384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d149b-b780-48ba-b9ef-3fb22a261f6b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.585958 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.586622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.586904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.587180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] PATH_INFO: `/v3/projects/f07ddfaeac0345989a5574df9eb9c0c0` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.588343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07ddfaeac0345989a5574df9eb9c0c0)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.590301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.616061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0b865-81f7-4de0-8d33-28c1ebd51f6f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.623975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.624755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.628233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.629202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.629904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.632340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.650248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1092/2157] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:50:59.653550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.664427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feee09-1f3d-4a58-9095-061ffbb17232 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.669561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.670248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.670534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.670807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.671480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.673124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.684603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1093/2158] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:50:59.688690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.699720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610e702-1b39-49c3-ad8e-e247131329ca admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.712467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07ddfaeac0345989a5574df9eb9c0c0', 'request_id': 'req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:59.718793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07ddfaeac0345989a5574df9eb9c0c0', 'request_id': 'req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:59.765692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c989e05-75ca-4c90-82e5-42fe73481a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:50:59.766370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c989e05-75ca-4c90-82e5-42fe73481a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.769899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c989e05-75ca-4c90-82e5-42fe73481a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.769899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c989e05-75ca-4c90-82e5-42fe73481a96 admin admin] PATH_INFO: `/v3/projects/a66833ea5e594bb69c782351e73334f6/users/a7d69bd03da54164b20fc93520c0ed24/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.787956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c989e05-75ca-4c90-82e5-42fe73481a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66833ea5e594bb69c782351e73334f6, user_id=a7d69bd03da54164b20fc93520c0ed24, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:50:59.792057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c989e05-75ca-4c90-82e5-42fe73481a96 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:50:59.852240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07ddfaeac0345989a5574df9eb9c0c0', 'request_id': 'req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:59.907591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1094/2159] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:50:59 2022] PUT /identity/v3/projects/a66833ea5e594bb69c782351e73334f6/users/a7d69bd03da54164b20fc93520c0ed24/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:50:59.907793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] The token cache is being invalidate because project f07ddfaeac0345989a5574df9eb9c0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:50:59.907793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:59.907793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:50:59.907793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1066/2160] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:50:59 2022] DELETE /identity/v3/projects/f07ddfaeac0345989a5574df9eb9c0c0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:50:59.923826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:50:59.925502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:50:59.926315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:50:59.926576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:50:59.929729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:50:59.952459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aedd1-c48a-49b4-80fe-8c2b56b9943b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:50:59.967942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] MFA Rules not processed for user `a7d69bd03da54164b20fc93520c0ed24`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:50:59.969321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:00.073422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1095/2161] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:50:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:00.076971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:00.079247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:00.112526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:00.116882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:00.117487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:00.119339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] PATH_INFO: `/v3/users/af6a52a14826408098da88b8a02c73d5` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:00.124568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6a52a14826408098da88b8a02c73d5)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:00.134085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:00.267264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f61ce-97df-4921-8442-bbdc1cd2786f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:00.273491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:00.274431 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:00.276279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:00.276837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:00.277750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:00.280285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:00.379412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6a52a14826408098da88b8a02c73d5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:00.380455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6a52a14826408098da88b8a02c73d5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:00.396943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6a52a14826408098da88b8a02c73d5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:00.455711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1096/2162] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:00 2022] POST /identity/v3/projects => generated 387 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:00.461187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:00.463633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:00.527380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6a52a14826408098da88b8a02c73d5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:00.528420 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6a52a14826408098da88b8a02c73d5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:00.557216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:00.562225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1067/2163] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:50:59 2022] DELETE /identity/v3/users/af6a52a14826408098da88b8a02c73d5 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:00.571831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c560f1-484c-401e-bb09-87c3bebc47eb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:00.647692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:00.648312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:00.648605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:00.648951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:00.649705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:00.653472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:00.759299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1097/2164] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:00 2022] POST /identity/v3/users => generated 300 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:00.762915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:00.774058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269802db-9054-497b-bf32-b758489bcc3f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:00.779254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:00.779910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:00.780193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:00.780467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:00.781401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:00.782899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:00.796768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1068/2165] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:00.801067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:00.815226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7c01-3e28-4115-9618-be81d4561a80 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:00.824456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:00.825050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:00.825332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:00.825663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] PATH_INFO: `/v3/projects/8c604b1bdf924945b8df13ca38d4f8ab/users/256fb02733564c3e9e06f5e8ac12f293/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:00.845614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c604b1bdf924945b8df13ca38d4f8ab, user_id=256fb02733564c3e9e06f5e8ac12f293, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:00.848256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:00.962933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1098/2166] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:00 2022] PUT /identity/v3/projects/8c604b1bdf924945b8df13ca38d4f8ab/users/256fb02733564c3e9e06f5e8ac12f293/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:00.964250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:00.980343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cba6ab-720f-4834-afed-695d19b61e4c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:01.058773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c384e-1c6e-463b-830b-19d05f2fae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:01.060146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c384e-1c6e-463b-830b-19d05f2fae8e admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:01.060501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c384e-1c6e-463b-830b-19d05f2fae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:01.060866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c384e-1c6e-463b-830b-19d05f2fae8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:01.062881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c384e-1c6e-463b-830b-19d05f2fae8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:01.065063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c384e-1c6e-463b-830b-19d05f2fae8e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:01.081522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1069/2167] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:51:01.084275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:01.109444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081a860-3fa3-43b4-9740-0527f9780b96 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:01.122106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:01.123050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:01.123337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:01.126035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] PATH_INFO: `/v3/projects/8c604b1bdf924945b8df13ca38d4f8ab/users/256fb02733564c3e9e06f5e8ac12f293/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:01.133346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c604b1bdf924945b8df13ca38d4f8ab, user_id=256fb02733564c3e9e06f5e8ac12f293, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:01.143058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:01.166518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1099/2168] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:01 2022] PUT /identity/v3/projects/8c604b1bdf924945b8df13ca38d4f8ab/users/256fb02733564c3e9e06f5e8ac12f293/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:51:01.177999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:01.178311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:01.178874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:01.213850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:01.215844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:01.246376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] MFA Rules not processed for user `256fb02733564c3e9e06f5e8ac12f293`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:01.247638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:01.384988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af80a0-5ae9-4a5a-8b35-05757f4f7a3e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:01.404525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1070/2169] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:01.404707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:01.405195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:01.405484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:01.405787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] PATH_INFO: `/v3/projects/21c4573b0f5b4c0c9cc9214abbc76e60` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:01.410230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c4573b0f5b4c0c9cc9214abbc76e60)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:01.415457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:01.416676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:01.419146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:01.465669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:01.579660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e07e6-6bd4-45ca-b846-b0101e2986a4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:01.596046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdeab4-3ea4-4e55-bc69-f3751c80bb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:01.596656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdeab4-3ea4-4e55-bc69-f3751c80bb2a service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:01.596939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdeab4-3ea4-4e55-bc69-f3751c80bb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:01.598077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdeab4-3ea4-4e55-bc69-f3751c80bb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:01.613738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c4573b0f5b4c0c9cc9214abbc76e60', 'request_id': 'req-2f189612-444b-48ee-9340-574ada7c5bce'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:01.635181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdeab4-3ea4-4e55-bc69-f3751c80bb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:01.637474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdeab4-3ea4-4e55-bc69-f3751c80bb2a service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:01.638903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c4573b0f5b4c0c9cc9214abbc76e60', 'request_id': 'req-2f189612-444b-48ee-9340-574ada7c5bce'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:01.708516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1071/2170] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:01.775084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c4573b0f5b4c0c9cc9214abbc76e60', 'request_id': 'req-2f189612-444b-48ee-9340-574ada7c5bce'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:01.823520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] The token cache is being invalidate because project 21c4573b0f5b4c0c9cc9214abbc76e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:01.827321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:01.830845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:01.844263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1100/2171] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:01 2022] DELETE /identity/v3/projects/21c4573b0f5b4c0c9cc9214abbc76e60 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:01.844453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73671a9-fbc0-4793-860f-2dc4cfc0670e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:01.844640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73671a9-fbc0-4793-860f-2dc4cfc0670e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:01.844910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73671a9-fbc0-4793-860f-2dc4cfc0670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:01.888328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:01.902131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-e73671a9-fbc0-4793-860f-2dc4cfc0670e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:01.903436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e73671a9-fbc0-4793-860f-2dc4cfc0670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:01.957741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:01.959958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:02.070600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1072/2172] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:02.078526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524561-218e-4709-82dc-62c16c349b1d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.078812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524561-218e-4709-82dc-62c16c349b1d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.079096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524561-218e-4709-82dc-62c16c349b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.103158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f189612-444b-48ee-9340-574ada7c5bce admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:02.109614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f2524561-218e-4709-82dc-62c16c349b1d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:02.110376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:02.110847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f2524561-218e-4709-82dc-62c16c349b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:02.111161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.111545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.111949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] PATH_INFO: `/v3/users/a7d69bd03da54164b20fc93520c0ed24` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.114327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d69bd03da54164b20fc93520c0ed24)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:02.116339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:02.136237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1073/2173] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:02.141121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524561-218e-4709-82dc-62c16c349b1d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:02.168868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524561-218e-4709-82dc-62c16c349b1d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:02.183367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:02.184093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.184388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.185090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.185378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:51:02.185688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:02.187470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:02.216085 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1074/2174] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:51:02.220718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:02.240359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad10658-17f1-43d7-adce-f3e876cbb387 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:02.257096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:02.257096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.257394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.258064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.258488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:02.260650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:02.332950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d69bd03da54164b20fc93520c0ed24'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:02.334677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d69bd03da54164b20fc93520c0ed24'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:02.372858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d69bd03da54164b20fc93520c0ed24'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:02.388001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1075/2175] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:02 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:51:02.393713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:02.397367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:02.510567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d69bd03da54164b20fc93520c0ed24'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:02.512163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cd1303cb-000e-4dfc-83b3-e0bbe9d62d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d69bd03da54164b20fc93520c0ed24'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:02.539302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1101/2176] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:01 2022] DELETE /identity/v3/users/a7d69bd03da54164b20fc93520c0ed24 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:51:02.543460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.543928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.544375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.577791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2dfc-1039-4c4e-b1e7-e93f31cd5f81 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:02.590718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:02.599928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:02.700790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:02.702703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.702703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.702920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.704895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:02.709071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:02.735045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1102/2177] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:02.756878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:02.758433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:02.857188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1076/2178] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:02 2022] POST /identity/v3/users => generated 287 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:02.858342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:02.883169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554af74-c491-4cd2-8472-d2dae8360047 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:02.898594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143c682-f95b-4745-8ef1-776760ee8fc4 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:02.900071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:02.900700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.900981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.901254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.901909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:02.903541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:02.908311 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:02.910591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.910591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.912113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.934146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:02.937587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1077/2179] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:51:02.938792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:02.938904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:02.960622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09ea0e-ecfd-4c1b-9b95-7a0e40898d07 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:02.966265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1103/2180] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:02.976208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061172e-d207-413d-af06-350a15259945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:02.976950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061172e-d207-413d-af06-350a15259945 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:02.977233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061172e-d207-413d-af06-350a15259945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:02.977786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061172e-d207-413d-af06-350a15259945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:02.980765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061172e-d207-413d-af06-350a15259945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:02.982402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061172e-d207-413d-af06-350a15259945 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:03.029800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1078/2181] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:51:03.034408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:03.057377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b80682-d7c2-4fad-a206-93ef42daad6a service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:03.066524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:03.070792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:03.070792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:03.070792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] PATH_INFO: `/v3/projects/efb655f543784b78857507c8d0fec7ef/users/583aaa3627534288aff029ff9c2ba044/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:03.091756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb655f543784b78857507c8d0fec7ef, user_id=583aaa3627534288aff029ff9c2ba044, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:03.142774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:03.155576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:03.283294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1104/2182] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:03 2022] PUT /identity/v3/projects/efb655f543784b78857507c8d0fec7ef/users/583aaa3627534288aff029ff9c2ba044/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:03.288432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:03.289050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:03.289525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:03.332474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] MFA Rules not processed for user `583aaa3627534288aff029ff9c2ba044`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:03.333763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:03.436337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:03.439463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1079/2183] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:03.459076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:03.460881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:03.552718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13704-2b39-4b0a-87f5-f5952594c2a1 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:03.560099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:03.560915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:03.561055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:03.561336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:03.578402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:03.582488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:03.608232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1105/2184] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:03.807730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:04.395677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:04.397674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:04.512555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d02ad-1576-44de-ba9e-177b654ff4a2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:04.533873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:04.535748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:04.536271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:04.536860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] PATH_INFO: `/v3/projects/a66833ea5e594bb69c782351e73334f6` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:04.539444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66833ea5e594bb69c782351e73334f6)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:04.567469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:04.790249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66833ea5e594bb69c782351e73334f6', 'request_id': 'req-3bc56a98-b26c-4950-855d-3214a811b867'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:04.799490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66833ea5e594bb69c782351e73334f6', 'request_id': 'req-3bc56a98-b26c-4950-855d-3214a811b867'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:04.917080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66833ea5e594bb69c782351e73334f6', 'request_id': 'req-3bc56a98-b26c-4950-855d-3214a811b867'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:04.953921 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] The token cache is being invalidate because project a66833ea5e594bb69c782351e73334f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:04.954285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:04.954969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:04.956705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1080/2185] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:04 2022] DELETE /identity/v3/projects/a66833ea5e594bb69c782351e73334f6 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:04.960870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:04.980689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea381380-6245-4f79-b2b9-b27a159bb129 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:05.124205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:05.125126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:05.125557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:05.126189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] PATH_INFO: `/v3/users/256fb02733564c3e9e06f5e8ac12f293` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:05.127706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256fb02733564c3e9e06f5e8ac12f293)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:05.130421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:05.406818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256fb02733564c3e9e06f5e8ac12f293'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:05.408286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256fb02733564c3e9e06f5e8ac12f293'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:05.422458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256fb02733564c3e9e06f5e8ac12f293'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:05.533360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256fb02733564c3e9e06f5e8ac12f293'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:05.534061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-27d77e39-6c8c-44d6-b4e7-b544b06bde85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256fb02733564c3e9e06f5e8ac12f293'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:05.549346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1106/2186] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:04 2022] DELETE /identity/v3/users/256fb02733564c3e9e06f5e8ac12f293 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:05.635914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:05.767302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:06.320207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:06.322007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:06.342888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56a98-b26c-4950-855d-3214a811b867 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:06.469099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:06.469099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:06.469099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:06.469099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] PATH_INFO: `/v3/projects/8c604b1bdf924945b8df13ca38d4f8ab` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:06.469394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c604b1bdf924945b8df13ca38d4f8ab)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:06.471812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:06.692567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c604b1bdf924945b8df13ca38d4f8ab', 'request_id': 'req-325db30a-df2b-4075-a3ed-138019d9fdb3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:06.706905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c604b1bdf924945b8df13ca38d4f8ab', 'request_id': 'req-325db30a-df2b-4075-a3ed-138019d9fdb3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:06.809324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c604b1bdf924945b8df13ca38d4f8ab', 'request_id': 'req-325db30a-df2b-4075-a3ed-138019d9fdb3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:06.843077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] The token cache is being invalidate because project 8c604b1bdf924945b8df13ca38d4f8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:06.843623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:06.848256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-325db30a-df2b-4075-a3ed-138019d9fdb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:06.852241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1081/2187] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:06 2022] DELETE /identity/v3/projects/8c604b1bdf924945b8df13ca38d4f8ab => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:06.857202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098979-3702-45f2-b697-40beb9d01e7a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:06.857679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098979-3702-45f2-b697-40beb9d01e7a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:06.857759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7098979-3702-45f2-b697-40beb9d01e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:06.883454 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b7098979-3702-45f2-b697-40beb9d01e7a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:06.885266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b7098979-3702-45f2-b697-40beb9d01e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:06.970438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1107/2188] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:06.983328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34731813-9b23-4cd2-8bb1-e87f1848b0a8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:06.983698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34731813-9b23-4cd2-8bb1-e87f1848b0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:06.984469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34731813-9b23-4cd2-8bb1-e87f1848b0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.014145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-34731813-9b23-4cd2-8bb1-e87f1848b0a8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:07.016057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-34731813-9b23-4cd2-8bb1-e87f1848b0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:07.028986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1082/2189] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:07.033140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7098979-3702-45f2-b697-40beb9d01e7a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:07.044491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7098979-3702-45f2-b697-40beb9d01e7a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:07.049547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:07.050708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:07.050935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:07.051212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.051915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:51:07.052221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:07.053944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:07.076873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1108/2190] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:51:07.077966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34731813-9b23-4cd2-8bb1-e87f1848b0a8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:07.087847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34731813-9b23-4cd2-8bb1-e87f1848b0a8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:07.093208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:07.093825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:07.094330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:07.094607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.095536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:07.098600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:07.265657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1083/2191] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:07 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:07.265807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:07.277085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561e7d-8d2b-41de-bcb3-f313ab621d1b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:07.413103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:07.414082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:07.415056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:07.419095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.419095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:07.419095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:07.594253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1109/2192] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:07 2022] POST /identity/v3/users => generated 286 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:07.595866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:07.617272 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c40e-eb67-46fe-8b8e-d49edc7fd10c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:07.624143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:07.625370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:07.625370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:07.625370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.625986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:07.634043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:07.666216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1084/2193] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:07.670737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:07.687486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349d4a0-06d4-42da-badf-f7d65ec4bace admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:07.694183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc44d6-d357-45cc-8f80-5364d349c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:07.694394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc44d6-d357-45cc-8f80-5364d349c313 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:07.698317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc44d6-d357-45cc-8f80-5364d349c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:07.698317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc44d6-d357-45cc-8f80-5364d349c313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.698317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc44d6-d357-45cc-8f80-5364d349c313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:07.698317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc44d6-d357-45cc-8f80-5364d349c313 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:07.716731 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1110/2194] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:07.717670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:07.742484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19edf-f3e7-40fe-9a7d-d40e659b8be3 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:07.757287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:07.757287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:07.757287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:07.757287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] PATH_INFO: `/v3/projects/6098c03781574dc39c88cae6837d60e6/users/e4cc3b80021344b588f7b159fcecf8a6/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.789414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6098c03781574dc39c88cae6837d60e6, user_id=e4cc3b80021344b588f7b159fcecf8a6, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:07.798246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:07.826983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:07.912369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1085/2195] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:07 2022] PUT /identity/v3/projects/6098c03781574dc39c88cae6837d60e6/users/e4cc3b80021344b588f7b159fcecf8a6/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:51:07.918982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99039d4-1d8e-4d76-8f2f-015fc49f7ba9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:07.919822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99039d4-1d8e-4d76-8f2f-015fc49f7ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:07.920305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99039d4-1d8e-4d76-8f2f-015fc49f7ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:07.975973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d99039d4-1d8e-4d76-8f2f-015fc49f7ba9 None None] MFA Rules not processed for user `e4cc3b80021344b588f7b159fcecf8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:07.977300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d99039d4-1d8e-4d76-8f2f-015fc49f7ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:08.080717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1111/2196] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:08.092494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:08.094203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:08.101097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:08.158467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaca1da-0762-4088-a36c-61129350fd04 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:08.163298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3865e0-45be-4436-b496-3e0d762ca040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:08.166771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3865e0-45be-4436-b496-3e0d762ca040 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:08.166771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3865e0-45be-4436-b496-3e0d762ca040 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:08.166771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3865e0-45be-4436-b496-3e0d762ca040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:08.200419 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3865e0-45be-4436-b496-3e0d762ca040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:08.202498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3865e0-45be-4436-b496-3e0d762ca040 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:08.213255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1086/2197] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:08.236069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99039d4-1d8e-4d76-8f2f-015fc49f7ba9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:08.314817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99039d4-1d8e-4d76-8f2f-015fc49f7ba9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:08.320663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:08.325554 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:08.325878 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:08.326162 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] PATH_INFO: `/v3/users/e4cc3b80021344b588f7b159fcecf8a6` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:08.328567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cc3b80021344b588f7b159fcecf8a6)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:08.330105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:08.600424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cc3b80021344b588f7b159fcecf8a6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:08.601434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cc3b80021344b588f7b159fcecf8a6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:08.633243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cc3b80021344b588f7b159fcecf8a6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:08.679389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:08.679856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:08.680583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:08.704601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cc3b80021344b588f7b159fcecf8a6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:08.705202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-527947cb-ba9e-4429-8b34-7d270277101e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cc3b80021344b588f7b159fcecf8a6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:08.718263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] MFA Rules not processed for user `6b6f9b0e8991496c9d3f9060b893e0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:08.719520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:08.725020 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1112/2198] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:08 2022] DELETE /identity/v3/users/e4cc3b80021344b588f7b159fcecf8a6 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:08.729429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:08.729719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:08.729995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:08.754808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:08.756094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:08.809896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1087/2199] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:08.829392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:08.830848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:08.866988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1113/2200] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:08.874706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:08.874706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:08.891408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66a0f6-a587-45f3-ba4a-5a976c938df1 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:08.898998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:08.899856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:08.900150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:08.900589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] PATH_INFO: `/v3/users/583aaa3627534288aff029ff9c2ba044` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:08.902568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] RBAC: Authorizing `identity:delete_user(user_id=583aaa3627534288aff029ff9c2ba044)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:08.904573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:08.986378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a98e7-5835-44d5-82d9-f53fdb675891 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:09.045626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:09.046108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:09.046389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:09.046665 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:09.048493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:09.120067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:09.121653 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:09.132804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1088/2201] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:51:09.140452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:09.142191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:09.233968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583aaa3627534288aff029ff9c2ba044'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:09.238648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583aaa3627534288aff029ff9c2ba044'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:09.252121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a497-e8f0-4964-a7f3-2596148931c2 service glance] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:09.255191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583aaa3627534288aff029ff9c2ba044'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:09.262017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663d93a-b2ff-475d-a96c-5765e80568f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:09.263007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663d93a-b2ff-475d-a96c-5765e80568f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:09.263470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663d93a-b2ff-475d-a96c-5765e80568f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:09.263932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663d93a-b2ff-475d-a96c-5765e80568f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:09.266709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2663d93a-b2ff-475d-a96c-5765e80568f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:09.284997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663d93a-b2ff-475d-a96c-5765e80568f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:09.287185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663d93a-b2ff-475d-a96c-5765e80568f4 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:09.333300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583aaa3627534288aff029ff9c2ba044'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:09.336335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8ebf3092-1939-45c4-aa2f-2b26cdfe610e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583aaa3627534288aff029ff9c2ba044'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:09.338550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1089/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:09.355971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1114/2203] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:08 2022] DELETE /identity/v3/users/583aaa3627534288aff029ff9c2ba044 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:09.363737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:09.364076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:09.364896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:09.482960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:09.483142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:09.483441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:09.525674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:09.526943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:09.570788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:09.572400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:09.610740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1115/2204] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:51:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:09.646581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1090/2205] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:09.658179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:09.660324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:09.662081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:09.665263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:09.762210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836a447-ba48-48b5-b2cb-d8b573ed545e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:09.767272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe515e-bf79-404e-96a5-eda9ce5755ba None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:09.772464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:09.772888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06d76b-ec20-44a7-86cf-53cd11960d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:09.773143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:09.773480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:09.773633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06d76b-ec20-44a7-86cf-53cd11960d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:09.773797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:09.774095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06d76b-ec20-44a7-86cf-53cd11960d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:09.774435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06d76b-ec20-44a7-86cf-53cd11960d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:09.788597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06d76b-ec20-44a7-86cf-53cd11960d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:09.789067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:09.791536 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:09.793613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06d76b-ec20-44a7-86cf-53cd11960d4f service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:09.808622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1091/2206] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:51:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:51:09.809442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1116/2207] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:10.112994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:10.119903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:10.186504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190f8ba-3cf7-4be1-a115-c775c1348c7c service swift] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:10.194379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:10.195349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:10.196292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:10.196833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] PATH_INFO: `/v3/projects/6098c03781574dc39c88cae6837d60e6` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:10.198361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6098c03781574dc39c88cae6837d60e6)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:10.200709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:10.418407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6098c03781574dc39c88cae6837d60e6', 'request_id': 'req-4df7bf55-2350-4967-b11b-7eb1a37d9679'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:10.439814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6098c03781574dc39c88cae6837d60e6', 'request_id': 'req-4df7bf55-2350-4967-b11b-7eb1a37d9679'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:10.579469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6098c03781574dc39c88cae6837d60e6', 'request_id': 'req-4df7bf55-2350-4967-b11b-7eb1a37d9679'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:10.622832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] The token cache is being invalidate because project 6098c03781574dc39c88cae6837d60e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:10.622832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:10.622832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4df7bf55-2350-4967-b11b-7eb1a37d9679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:10.628040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1092/2208] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:10 2022] DELETE /identity/v3/projects/6098c03781574dc39c88cae6837d60e6 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:10.631990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232f6ad-ade5-4fbd-8cd6-822954e6439e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:10.632543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232f6ad-ade5-4fbd-8cd6-822954e6439e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:10.633025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232f6ad-ade5-4fbd-8cd6-822954e6439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:10.677061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a232f6ad-ade5-4fbd-8cd6-822954e6439e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:10.678401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a232f6ad-ade5-4fbd-8cd6-822954e6439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:10.826804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1117/2209] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:10.835194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4986978-dbf3-4048-ac35-cd7de4f3770e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:10.835530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4986978-dbf3-4048-ac35-cd7de4f3770e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:10.836137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4986978-dbf3-4048-ac35-cd7de4f3770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:10.868566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d4986978-dbf3-4048-ac35-cd7de4f3770e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:10.869803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d4986978-dbf3-4048-ac35-cd7de4f3770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:10.896199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1093/2210] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:10.901039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232f6ad-ade5-4fbd-8cd6-822954e6439e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:10.927903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232f6ad-ade5-4fbd-8cd6-822954e6439e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:10.949915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:10.950711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:10.951053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:10.951391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:10.952152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:51:10.953820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:10.957549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:11.027877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1118/2211] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:51:11.086985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4986978-dbf3-4048-ac35-cd7de4f3770e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:11.086985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4986978-dbf3-4048-ac35-cd7de4f3770e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:11.103884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:11.104555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:11.104839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:11.105126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:11.105782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:11.108698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:11.304449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1094/2212] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:11 2022] POST /identity/v3/projects => generated 375 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:11.306606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:11.330094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff4fa-ecf3-44d2-9a85-93137b4f2734 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:11.411669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:11.412418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:11.412766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:11.413118 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:11.413838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:11.416045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:11.520013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:11.523730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:11.553933 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1119/2213] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:11 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:11.558676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:11.561015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aee202-e592-44ca-90f4-03f98b762440 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:11.585360 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:11.586166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:11.586551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:11.586926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] PATH_INFO: `/v3/projects/efb655f543784b78857507c8d0fec7ef` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:11.595114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb655f543784b78857507c8d0fec7ef)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:11.604625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9424e7-2f47-45ec-b3b6-6883bed37629 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:11.605260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:11.624552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:11.628700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:11.628700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:11.631570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:11.636424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:11.663768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:11.714837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1120/2214] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:11.719695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:11.748596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8e118-6a4b-48c7-b926-e7d269d0833e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:11.760155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:11.761547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:11.761934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:11.764744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:11.765553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:11.769541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:11.800989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1121/2215] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:11.802326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:11.840538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb616-79d9-47f6-9680-b3c5055fa7d9 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:11.858736 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb655f543784b78857507c8d0fec7ef', 'request_id': 'req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:11.873477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb655f543784b78857507c8d0fec7ef', 'request_id': 'req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:11.903170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:11.970358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb655f543784b78857507c8d0fec7ef', 'request_id': 'req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:11.993685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] The token cache is being invalidate because project efb655f543784b78857507c8d0fec7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:11.994271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:11.995196 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-dff94f1f-084f-41a6-a7d4-be1cb8582ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:12.000860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1095/2216] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:11 2022] DELETE /identity/v3/projects/efb655f543784b78857507c8d0fec7ef => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:12.002847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ff2a-6e3e-4f58-a8ae-57f42e8a7efa None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.004011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ff2a-6e3e-4f58-a8ae-57f42e8a7efa None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.004682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ff2a-6e3e-4f58-a8ae-57f42e8a7efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.007308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5ca4f-d21e-44aa-8b0e-9454efa2e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:12.008006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ca4f-d21e-44aa-8b0e-9454efa2e749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.008286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ca4f-d21e-44aa-8b0e-9454efa2e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.008615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ca4f-d21e-44aa-8b0e-9454efa2e749 admin admin] PATH_INFO: `/v3/projects/86476887e8e5446e93ffdbde0e3eaea1/users/e801e9862ce6469286c7dcd70f67b65f/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.033127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5323ff2a-6e3e-4f58-a8ae-57f42e8a7efa None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:12.035070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5323ff2a-6e3e-4f58-a8ae-57f42e8a7efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:12.047004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5ca4f-d21e-44aa-8b0e-9454efa2e749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86476887e8e5446e93ffdbde0e3eaea1, user_id=e801e9862ce6469286c7dcd70f67b65f, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:12.050729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5ca4f-d21e-44aa-8b0e-9454efa2e749 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:12.058152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1096/2217] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:12.068264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670141b4-fc0c-4a31-99f1-50b83a94e09f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.069566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670141b4-fc0c-4a31-99f1-50b83a94e09f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.070018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670141b4-fc0c-4a31-99f1-50b83a94e09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.094694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-670141b4-fc0c-4a31-99f1-50b83a94e09f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:12.097271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-670141b4-fc0c-4a31-99f1-50b83a94e09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:12.109234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1097/2218] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:12.115143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670141b4-fc0c-4a31-99f1-50b83a94e09f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:12.126084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670141b4-fc0c-4a31-99f1-50b83a94e09f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:12.133567 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:12.135329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.135719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.136565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.137811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:51:12.138909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:12.141695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:12.156173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1122/2219] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:11 2022] PUT /identity/v3/projects/86476887e8e5446e93ffdbde0e3eaea1/users/e801e9862ce6469286c7dcd70f67b65f/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:12.161930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.162196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.162472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.165839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1098/2220] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:51:12.176595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:12.207907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f774ccb-c486-4845-ad11-854124f13dc8 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:12.257621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] MFA Rules not processed for user `e801e9862ce6469286c7dcd70f67b65f`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:12.259234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:12.379908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:12.383462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.390636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.390636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.390636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:12.390636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:12.438694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1123/2221] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:12.453149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:12.457012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:12.529652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:12.543321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1099/2222] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:12 2022] POST /identity/v3/projects => generated 391 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:12.544834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:12.662033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d4ad5-c0dd-4551-91d6-c5c15a8a7ed9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:12.775611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987957e-6057-474d-9c65-94db27859ae5 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:12.793497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:12.795670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.798391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.801143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.802822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:12.809850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:12.875718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:12.875718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:12.875718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:12.875718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:12.991304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1100/2223] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:12 2022] POST /identity/v3/users => generated 296 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:51:12.994954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:13.013408 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cacbd-43f5-4f61-84fd-e4dd3a3e0b33 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:13.015610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:13.016063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:13.017185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:13.017480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:13.017754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:13.018203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:13.018533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:13.021103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:13.033488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1101/2224] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:51:13.043561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1124/2225] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:51:13.050307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:13.089531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87f52-23ce-429f-8380-7f7adb1b47b9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:13.098258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05804b04-6930-4425-98bc-148e1b3491a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:13.098883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05804b04-6930-4425-98bc-148e1b3491a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:13.099166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05804b04-6930-4425-98bc-148e1b3491a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:13.099453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05804b04-6930-4425-98bc-148e1b3491a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:13.100161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05804b04-6930-4425-98bc-148e1b3491a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:13.102641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05804b04-6930-4425-98bc-148e1b3491a5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:13.143156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1102/2226] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:13.147615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:13.168287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8607b6-7eb0-473b-831f-4d8a3bb5869f service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:13.183883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:13.184569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:13.184851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:13.185131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] PATH_INFO: `/v3/projects/627c7043cc8c486c9e2e174b2686fffa/users/1e7cb97df1c44faf9d7dec1b8c24d0b3/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:13.220762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627c7043cc8c486c9e2e174b2686fffa, user_id=1e7cb97df1c44faf9d7dec1b8c24d0b3, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:13.227873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:13.335463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1125/2227] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:13 2022] PUT /identity/v3/projects/627c7043cc8c486c9e2e174b2686fffa/users/1e7cb97df1c44faf9d7dec1b8c24d0b3/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:13.345867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6d6e-222b-4f2e-90b0-4709a6bbbee5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:13.346143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6d6e-222b-4f2e-90b0-4709a6bbbee5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:13.347238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6d6e-222b-4f2e-90b0-4709a6bbbee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:13.391729 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d09d6d6e-222b-4f2e-90b0-4709a6bbbee5 None None] MFA Rules not processed for user `1e7cb97df1c44faf9d7dec1b8c24d0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:13.392951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d09d6d6e-222b-4f2e-90b0-4709a6bbbee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:13.489764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1103/2228] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:13.498021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:13.500491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:13.644884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e1381-c431-4db7-874b-e0c56e852379 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:13.653940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7959c2b-c6fa-481d-9ffa-7365edfbe3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:13.654852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7959c2b-c6fa-481d-9ffa-7365edfbe3cf service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:13.657978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7959c2b-c6fa-481d-9ffa-7365edfbe3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:13.658446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7959c2b-c6fa-481d-9ffa-7365edfbe3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:13.684306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7959c2b-c6fa-481d-9ffa-7365edfbe3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:13.685767 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7959c2b-c6fa-481d-9ffa-7365edfbe3cf service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:13.714550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1126/2229] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:15.704622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:16.682240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:18.361245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:18.922058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:19.435818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:22.072927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:23.322526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:23.870381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:24.583584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:24.601669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88cf2-9cd6-4d9b-9c17-844115ab555f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:24.601960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88cf2-9cd6-4d9b-9c17-844115ab555f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:24.602358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88cf2-9cd6-4d9b-9c17-844115ab555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:24.648999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-03e88cf2-9cd6-4d9b-9c17-844115ab555f None None] MFA Rules not processed for user `0150a12ff77b433496b370fa47f0dbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:24.650525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-03e88cf2-9cd6-4d9b-9c17-844115ab555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:24.767810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1104/2230] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:25.524224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae34b1-abc1-4b36-a23d-adc30bbc1edb None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:25.524791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae34b1-abc1-4b36-a23d-adc30bbc1edb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:25.524791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae34b1-abc1-4b36-a23d-adc30bbc1edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:25.544138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-2bae34b1-abc1-4b36-a23d-adc30bbc1edb None None] MFA Rules not processed for user `696d5fdf3bae4dd5b33aa4bec27e87b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:25.552750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2bae34b1-abc1-4b36-a23d-adc30bbc1edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:25.600137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1127/2231] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:26.533736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:27.458652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:27.692137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a773-da3e-42dc-b2d2-313496dd3281 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:27.695494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a773-da3e-42dc-b2d2-313496dd3281 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:27.696008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a773-da3e-42dc-b2d2-313496dd3281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:27.759014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5d55a773-da3e-42dc-b2d2-313496dd3281 None None] MFA Rules not processed for user `33eafdd0753c43bb95584a2c6e578407`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:27.763219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5d55a773-da3e-42dc-b2d2-313496dd3281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:27.777381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:27.910948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1105/2232] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:28.990184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae34b1-abc1-4b36-a23d-adc30bbc1edb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:29.093636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae34b1-abc1-4b36-a23d-adc30bbc1edb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:29.099323 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:29.100026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:29.100497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:29.100774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] PATH_INFO: `/v3/users/1e7cb97df1c44faf9d7dec1b8c24d0b3` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:29.101940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7cb97df1c44faf9d7dec1b8c24d0b3)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:29.103903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:29.359241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7cb97df1c44faf9d7dec1b8c24d0b3'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:29.359975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7cb97df1c44faf9d7dec1b8c24d0b3'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:29.372676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7cb97df1c44faf9d7dec1b8c24d0b3'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:29.514823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7cb97df1c44faf9d7dec1b8c24d0b3'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:29.515464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7cb97df1c44faf9d7dec1b8c24d0b3'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:29.528522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1128/2233] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:28 2022] DELETE /identity/v3/users/1e7cb97df1c44faf9d7dec1b8c24d0b3 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:29.533093 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:29.534178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:29.534333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:29.563861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:29.565978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:29.632166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1106/2234] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:29.642126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:29.644236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:29.722919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934f6c7-812e-4647-8d34-4ee5dbcf59ed admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:29.728384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1e8f9-88d9-494c-92d5-4e4a4a4ee61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:29.730212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1e8f9-88d9-494c-92d5-4e4a4a4ee61c service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:29.730966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1e8f9-88d9-494c-92d5-4e4a4a4ee61c service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:29.732084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1e8f9-88d9-494c-92d5-4e4a4a4ee61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:29.744793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1e8f9-88d9-494c-92d5-4e4a4a4ee61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:29.748136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1e8f9-88d9-494c-92d5-4e4a4a4ee61c service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:29.767099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1129/2235] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:30.312582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:30.603606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:30.605221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:30.619751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a46e23-13b5-437b-8ca1-4e316a863abd None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:30.625943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:30.626850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:30.627583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:30.628308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] PATH_INFO: `/v3/projects/627c7043cc8c486c9e2e174b2686fffa` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:30.629928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627c7043cc8c486c9e2e174b2686fffa)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:30.639801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:30.738679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:30.807311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627c7043cc8c486c9e2e174b2686fffa', 'request_id': 'req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:30.816734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627c7043cc8c486c9e2e174b2686fffa', 'request_id': 'req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:30.949640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627c7043cc8c486c9e2e174b2686fffa', 'request_id': 'req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:30.967198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] The token cache is being invalidate because project 627c7043cc8c486c9e2e174b2686fffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:30.968003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:30.969454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-efe19b1f-8d30-4290-aa8b-2faa3da96cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:30.978363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1107/2236] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:30 2022] DELETE /identity/v3/projects/627c7043cc8c486c9e2e174b2686fffa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:30.979566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2aed2-d684-4b78-8a3c-8f6cf2dcc8ec None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:30.980376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2aed2-d684-4b78-8a3c-8f6cf2dcc8ec None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:30.980899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2aed2-d684-4b78-8a3c-8f6cf2dcc8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.004370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-97b2aed2-d684-4b78-8a3c-8f6cf2dcc8ec None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:31.005605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-97b2aed2-d684-4b78-8a3c-8f6cf2dcc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:31.086439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1130/2237] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:31.156743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96a04-0d52-4623-b3e7-0e1784710d8f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.158046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96a04-0d52-4623-b3e7-0e1784710d8f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.159070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96a04-0d52-4623-b3e7-0e1784710d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.186851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-80e96a04-0d52-4623-b3e7-0e1784710d8f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:31.188329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-80e96a04-0d52-4623-b3e7-0e1784710d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:31.200754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1108/2238] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:31.204799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2aed2-d684-4b78-8a3c-8f6cf2dcc8ec None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:31.216577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2aed2-d684-4b78-8a3c-8f6cf2dcc8ec None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:31.224199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:31.225011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.225685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.225956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.227256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:51:31.227893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:31.230079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:31.249505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1131/2239] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:51:31.254790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96a04-0d52-4623-b3e7-0e1784710d8f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:31.286106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96a04-0d52-4623-b3e7-0e1784710d8f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:31.301301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6cc23-bc5c-422d-ac9b-ac4a827b2e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:31.302053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6cc23-bc5c-422d-ac9b-ac4a827b2e3e admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.302410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6cc23-bc5c-422d-ac9b-ac4a827b2e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.302755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6cc23-bc5c-422d-ac9b-ac4a827b2e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.303509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6cc23-bc5c-422d-ac9b-ac4a827b2e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:31.308158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6cc23-bc5c-422d-ac9b-ac4a827b2e3e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:31.440741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1109/2240] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:31 2022] POST /identity/v3/projects => generated 397 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:31.445411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:31.485653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8442b2-c10a-47c9-ace2-d6aeee8d73fa admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:31.589001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:31.590660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.591235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.592181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.593203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:31.596909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:31.637401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aacec-6e10-495a-a2dd-d3a0cdaa91af None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.637947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aacec-6e10-495a-a2dd-d3a0cdaa91af None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.648919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7aacec-6e10-495a-a2dd-d3a0cdaa91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.689024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9d7aacec-6e10-495a-a2dd-d3a0cdaa91af None None] MFA Rules not processed for user `86312e5441df4cf89028fbe807bef5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:31.691183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9d7aacec-6e10-495a-a2dd-d3a0cdaa91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:31.708864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1132/2241] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:31 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:31.710785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:31.723753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc0d3-fdcd-434c-a73b-674998b2c3e6 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:31.729371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:31.730344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.730836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.731347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.732238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:31.734455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:31.762154 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1133/2242] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:31.763346 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:31.776120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f11db-fcc6-479f-87e6-a962cb736e94 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:31.788011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:31.788962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.789319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.789666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.793351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:31.795354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:31.818851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1134/2243] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:31.823526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1110/2244] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:31.823686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:31.836089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad92a0f-11f3-45a1-b00c-74130d9511ac admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:31.846333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:31.857138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:31.857138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:31.857138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] PATH_INFO: `/v3/projects/11d47a2c26e044ebbd7c87d96a4ce37f/users/58bb9ba6cca54c8198a709a4ea1528ed/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:31.867364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d47a2c26e044ebbd7c87d96a4ce37f, user_id=58bb9ba6cca54c8198a709a4ea1528ed, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:31.870919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:32.004710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1135/2245] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:31 2022] PUT /identity/v3/projects/11d47a2c26e044ebbd7c87d96a4ce37f/users/58bb9ba6cca54c8198a709a4ea1528ed/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:32.015084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897facbe-4d44-4791-bb41-798f0bd33c8d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:32.015577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897facbe-4d44-4791-bb41-798f0bd33c8d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:32.017533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897facbe-4d44-4791-bb41-798f0bd33c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:32.102335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-897facbe-4d44-4791-bb41-798f0bd33c8d None None] MFA Rules not processed for user `58bb9ba6cca54c8198a709a4ea1528ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:32.116106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-897facbe-4d44-4791-bb41-798f0bd33c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:32.198526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1111/2246] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:32.207484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:32.209281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:32.211038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:32.274440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053a55d-ea4d-42fa-82f8-ab0538a2ee4a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:32.278715 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:32.279206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:32.279522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:32.279807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:32.303705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:32.305322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:32.331836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1136/2247] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:33.186195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:33.190120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:33.190120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:33.255727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:33.279663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:33.283237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:33.386886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:33.388631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:33.454124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1112/2248] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:51:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:33.474814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:33.476908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:33.494283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcc7d9-a1fe-40b3-8b1b-8796b736bede service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:33.499191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:33.499889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:33.500340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:33.500758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] PATH_INFO: `/v3/users/e801e9862ce6469286c7dcd70f67b65f` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:33.502383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e801e9862ce6469286c7dcd70f67b65f)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:33.504787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:33.578633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a122-04c9-4b54-b65b-f0c81ee79db4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:33.584569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f2b59-72ff-4524-9ec7-897f324bc6af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:33.585318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2b59-72ff-4524-9ec7-897f324bc6af service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:33.585604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2b59-72ff-4524-9ec7-897f324bc6af service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:33.585882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2b59-72ff-4524-9ec7-897f324bc6af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:33.596530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f2b59-72ff-4524-9ec7-897f324bc6af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:33.598905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f2b59-72ff-4524-9ec7-897f324bc6af service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:33.607497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1113/2249] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:51:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 08:51:33.726430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e801e9862ce6469286c7dcd70f67b65f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:33.727185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e801e9862ce6469286c7dcd70f67b65f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:33.755967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e801e9862ce6469286c7dcd70f67b65f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:33.875150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e801e9862ce6469286c7dcd70f67b65f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:33.876631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e801e9862ce6469286c7dcd70f67b65f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:33.933093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1137/2250] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:33 2022] DELETE /identity/v3/users/e801e9862ce6469286c7dcd70f67b65f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:51:33.934771 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:33.935086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:33.935400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:33.978455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:33.980637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:34.117583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1114/2251] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:34.148439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:34.150070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:34.299917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a47fa9-afcd-4f55-8399-e0b5e059e364 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:34.309976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55211bd0-cdfd-4128-97af-ff0114bd8b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:34.310614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55211bd0-cdfd-4128-97af-ff0114bd8b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:34.310898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55211bd0-cdfd-4128-97af-ff0114bd8b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:34.311208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55211bd0-cdfd-4128-97af-ff0114bd8b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:34.348015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55211bd0-cdfd-4128-97af-ff0114bd8b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:34.349469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55211bd0-cdfd-4128-97af-ff0114bd8b03 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:34.372858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1138/2252] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:34.743776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:35.001119 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:35.742730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:35.744501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:35.763394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4612f-71a3-4422-b76b-78e958b87355 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:35.770226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:35.771407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:35.771997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:35.772883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] PATH_INFO: `/v3/projects/86476887e8e5446e93ffdbde0e3eaea1` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:35.776025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86476887e8e5446e93ffdbde0e3eaea1)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:35.778590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:35.887964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:35.950656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86476887e8e5446e93ffdbde0e3eaea1', 'request_id': 'req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:35.968429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86476887e8e5446e93ffdbde0e3eaea1', 'request_id': 'req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:36.035939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86476887e8e5446e93ffdbde0e3eaea1', 'request_id': 'req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:36.058158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] The token cache is being invalidate because project 86476887e8e5446e93ffdbde0e3eaea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:36.058497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:36.059647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf430e0d-d9b3-4b5b-9b0c-2dac45f08e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:36.064864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1115/2253] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:35 2022] DELETE /identity/v3/projects/86476887e8e5446e93ffdbde0e3eaea1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:36.066464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e3e0c-2e90-4818-94f2-6858ae8a03cf None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.066936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e3e0c-2e90-4818-94f2-6858ae8a03cf None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.067029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e3e0c-2e90-4818-94f2-6858ae8a03cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.094825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c41e3e0c-2e90-4818-94f2-6858ae8a03cf None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:36.097023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c41e3e0c-2e90-4818-94f2-6858ae8a03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:36.186934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1139/2254] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:36.195248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00894452-ce1a-4f93-b8db-e552a4a50d58 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.195575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00894452-ce1a-4f93-b8db-e552a4a50d58 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.195882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00894452-ce1a-4f93-b8db-e552a4a50d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.223488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:36.233217 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-00894452-ce1a-4f93-b8db-e552a4a50d58 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:36.234458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-00894452-ce1a-4f93-b8db-e552a4a50d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:36.258323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1116/2255] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:36.259567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e3e0c-2e90-4818-94f2-6858ae8a03cf None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:36.275256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e3e0c-2e90-4818-94f2-6858ae8a03cf None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:36.278293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:36.279018 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.279325 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.279806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.280393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:51:36.280743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:36.282460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:36.297532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1140/2256] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:51:36.304398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00894452-ce1a-4f93-b8db-e552a4a50d58 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:36.324772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00894452-ce1a-4f93-b8db-e552a4a50d58 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:36.342550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:36.343194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.343505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.343786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.344835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:36.347193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:36.482043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1117/2257] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:36 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:36.483284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:36.494083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563af1c-09eb-442b-8159-364c3baa2c55 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:36.592015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:36.596574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.596574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.596574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.596574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:36.596574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:36.682477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1141/2258] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:36 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:51:36.687924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:36.712765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82290-5819-4062-8517-8a93559501ee admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:36.734952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:36.735918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.738676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.748766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.768153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:36.768153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:36.804973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:36.807371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1118/2259] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:51:36.826488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818079db-6b72-468b-9017-d2098ad621f4 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:36.864558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288efd3-fc45-40bb-b20d-260fdb0fb991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:36.864558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288efd3-fc45-40bb-b20d-260fdb0fb991 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.864558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288efd3-fc45-40bb-b20d-260fdb0fb991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.864558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288efd3-fc45-40bb-b20d-260fdb0fb991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.865166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288efd3-fc45-40bb-b20d-260fdb0fb991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:36.865166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288efd3-fc45-40bb-b20d-260fdb0fb991 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:36.879445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1142/2260] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:36.883476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:36.897873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae587-9c3d-44b8-bf12-3616dd4a1974 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:36.940633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:36.940633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:36.940633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:36.940633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] PATH_INFO: `/v3/projects/265c82c77564406f8d57e2f3c63f89eb/users/c26da44234ad4dcdb671ab03a7154f22/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:36.983979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265c82c77564406f8d57e2f3c63f89eb, user_id=c26da44234ad4dcdb671ab03a7154f22, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:36.988888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:37.327097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:37.334669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1119/2261] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:36 2022] PUT /identity/v3/projects/265c82c77564406f8d57e2f3c63f89eb/users/c26da44234ad4dcdb671ab03a7154f22/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:37.354263 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4af79-d352-4cfc-bd5f-80badee0236b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:37.354790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4af79-d352-4cfc-bd5f-80badee0236b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:37.354790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4af79-d352-4cfc-bd5f-80badee0236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:37.396955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-02e4af79-d352-4cfc-bd5f-80badee0236b None None] MFA Rules not processed for user `c26da44234ad4dcdb671ab03a7154f22`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:37.398256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-02e4af79-d352-4cfc-bd5f-80badee0236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:37.474051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1143/2262] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:37.488057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:37.490499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:37.569841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abb8a7-27f6-4801-986e-4f1855df1ac2 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:37.583521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3e91-8996-4386-8011-bccf14d7df75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:37.589320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3e91-8996-4386-8011-bccf14d7df75 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:37.589320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3e91-8996-4386-8011-bccf14d7df75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:37.589320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3e91-8996-4386-8011-bccf14d7df75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:37.598061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f3e91-8996-4386-8011-bccf14d7df75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:37.600842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f3e91-8996-4386-8011-bccf14d7df75 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:37.623460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1120/2263] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:37.640339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4af79-d352-4cfc-bd5f-80badee0236b None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:37.724807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:37.742566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4af79-d352-4cfc-bd5f-80badee0236b None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:37.748638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:37.749604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:37.749962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:37.750248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] PATH_INFO: `/v3/users/c26da44234ad4dcdb671ab03a7154f22` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:37.756840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26da44234ad4dcdb671ab03a7154f22)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:37.759076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:38.065685 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26da44234ad4dcdb671ab03a7154f22'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:38.067133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26da44234ad4dcdb671ab03a7154f22'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:38.104563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26da44234ad4dcdb671ab03a7154f22'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:38.184109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26da44234ad4dcdb671ab03a7154f22'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:38.184916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26da44234ad4dcdb671ab03a7154f22'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:38.201285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1144/2264] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:37 2022] DELETE /identity/v3/users/c26da44234ad4dcdb671ab03a7154f22 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:38.206791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:38.212586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:38.212586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:38.240450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:38.241662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:38.327136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1121/2265] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:38.337022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:38.338507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:38.419969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6180cd6-c858-4469-b025-03c3ad735693 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:38.424753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:38.425900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:38.425900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:38.425900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:38.437456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:38.438698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:38.450213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1145/2266] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:38.576415 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:38.915381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:38.959147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:38.960710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:38.975250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466210a-d709-430c-bec8-945d3327d1b2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:38.991803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:38.995398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:38.995814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:38.996095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] PATH_INFO: `/v3/projects/265c82c77564406f8d57e2f3c63f89eb` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:38.998635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265c82c77564406f8d57e2f3c63f89eb)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:39.000992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:39.062398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:39.127405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:39.129247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:39.150328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a730f-fee9-4315-b586-a4e6314a6d07 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:39.176655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265c82c77564406f8d57e2f3c63f89eb', 'request_id': 'req-a839898f-f742-4c09-8bf3-8feb1724bbe1'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.200591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265c82c77564406f8d57e2f3c63f89eb', 'request_id': 'req-a839898f-f742-4c09-8bf3-8feb1724bbe1'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.278662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:39.279823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.280341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.280858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] PATH_INFO: `/v3/users/58bb9ba6cca54c8198a709a4ea1528ed` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.282368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bb9ba6cca54c8198a709a4ea1528ed)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:39.285139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:39.315946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265c82c77564406f8d57e2f3c63f89eb', 'request_id': 'req-a839898f-f742-4c09-8bf3-8feb1724bbe1'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.332555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] The token cache is being invalidate because project 265c82c77564406f8d57e2f3c63f89eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:39.333190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.333524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-a839898f-f742-4c09-8bf3-8feb1724bbe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.335564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1122/2267] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:38 2022] DELETE /identity/v3/projects/265c82c77564406f8d57e2f3c63f89eb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:39.340079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d814-3a9e-4a51-8eec-0fde8e0f6678 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.340563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d814-3a9e-4a51-8eec-0fde8e0f6678 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.341021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d814-3a9e-4a51-8eec-0fde8e0f6678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.373559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-53b5d814-3a9e-4a51-8eec-0fde8e0f6678 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:39.375278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-53b5d814-3a9e-4a51-8eec-0fde8e0f6678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:39.385556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1123/2268] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:39.397785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f271d9-4925-4a5b-a5b6-69c46f2738f6 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.398381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f271d9-4925-4a5b-a5b6-69c46f2738f6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.398838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f271d9-4925-4a5b-a5b6-69c46f2738f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.421308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-36f271d9-4925-4a5b-a5b6-69c46f2738f6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:39.422637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-36f271d9-4925-4a5b-a5b6-69c46f2738f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:39.432075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1124/2269] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:39.436133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f271d9-4925-4a5b-a5b6-69c46f2738f6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:39.448159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f271d9-4925-4a5b-a5b6-69c46f2738f6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:39.457502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:39.463125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.463531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.469760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.469760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:51:39.469760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:39.469760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:39.486721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1125/2270] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:51:39.490792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:39.510121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885227-c946-4dea-8655-2ddb8ac08921 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:39.515082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:39.516026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.516305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.516595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.517197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:39.519457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:39.607798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:39.637365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bb9ba6cca54c8198a709a4ea1528ed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.638371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bb9ba6cca54c8198a709a4ea1528ed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.661620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1126/2271] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:51:39 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:39.662828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:39.678599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bb9ba6cca54c8198a709a4ea1528ed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.680640 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:39.765299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bb9ba6cca54c8198a709a4ea1528ed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.766114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f8859770-b125-4ba8-9d12-c510130198ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bb9ba6cca54c8198a709a4ea1528ed'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:39.773606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a47663-f928-4d3e-bd8f-556d5ca17142 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:39.786586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1146/2272] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:51:39 2022] DELETE /identity/v3/users/58bb9ba6cca54c8198a709a4ea1528ed => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:51:39.798105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:39.799594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.799868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b6bf-a52c-43a0-9592-a8bc79092492 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.803123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.803254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b6bf-a52c-43a0-9592-a8bc79092492 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.803254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b6bf-a52c-43a0-9592-a8bc79092492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.803598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.803598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:39.803598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:39.832398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0120b6bf-a52c-43a0-9592-a8bc79092492 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:39.832900 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0120b6bf-a52c-43a0-9592-a8bc79092492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:39.940067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1147/2273] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:39.948268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1127/2274] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:51:39 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:51:39.952832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b6bf-a52c-43a0-9592-a8bc79092492 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:39.966704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:39.968037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b6bf-a52c-43a0-9592-a8bc79092492 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:39.983802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:39.983948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:39.983948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:39.983948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:39.983948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:39.984273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:39.984273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:39.989097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1148/2275] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:39.993796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:40.006725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fccf8-b9a4-43a7-b52f-99625410a384 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:40.012186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:40.012978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:40.013409 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:40.013793 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:40.014664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:40.016736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:40.035504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1149/2276] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:51:40.036946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:40.051616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cda880-05a9-4659-9c12-d5b6847b8c65 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:40.055453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ec58f-6188-4ba8-8fce-9af4e5eacac9 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:40.064522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:40.065269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:40.065549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:40.065897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] PATH_INFO: `/v3/projects/42a5362177fa4486ac94a9bd7c49d88c/users/fae5b787174b455ea56f9c409b3b1366/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:40.095184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a5362177fa4486ac94a9bd7c49d88c, user_id=fae5b787174b455ea56f9c409b3b1366, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:40.099292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:40.100212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:40.129806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1eda5-4b78-4619-b099-3933a52636f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:40.130503 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1eda5-4b78-4619-b099-3933a52636f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:40.130787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1eda5-4b78-4619-b099-3933a52636f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:40.131056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1eda5-4b78-4619-b099-3933a52636f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:40.139587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:40.141859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1eda5-4b78-4619-b099-3933a52636f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:40.144459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1eda5-4b78-4619-b099-3933a52636f1 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:40.157209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1128/2277] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:40.162788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1150/2278] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:51:40 2022] PUT /identity/v3/projects/42a5362177fa4486ac94a9bd7c49d88c/users/fae5b787174b455ea56f9c409b3b1366/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:40.167611 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:40.168268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:40.168547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:40.188787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:40.191069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:40.275848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1129/2279] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:40.286089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:40.288232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:40.447348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f96a3-61cc-493f-baec-086226a04781 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:40.461808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b03d-5fbe-4ba6-be3a-b3b52eacce3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:40.462598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b03d-5fbe-4ba6-be3a-b3b52eacce3a service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:40.462981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b03d-5fbe-4ba6-be3a-b3b52eacce3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:40.463398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b03d-5fbe-4ba6-be3a-b3b52eacce3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:40.480896 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b03d-5fbe-4ba6-be3a-b3b52eacce3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:40.482578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b03d-5fbe-4ba6-be3a-b3b52eacce3a service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:40.515942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1151/2280] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:40.954485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:40.975706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:40.996721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f99e27-c8eb-41e6-b2f4-8fc25d319b06 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:41.009313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:41.029509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:41.029826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:41.033373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] PATH_INFO: `/v3/projects/11d47a2c26e044ebbd7c87d96a4ce37f` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:41.033373 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d47a2c26e044ebbd7c87d96a4ce37f)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:41.034737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:41.173223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d47a2c26e044ebbd7c87d96a4ce37f', 'request_id': 'req-39ba4a41-6981-4fed-a29e-a575c8ee57fd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:41.180649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d47a2c26e044ebbd7c87d96a4ce37f', 'request_id': 'req-39ba4a41-6981-4fed-a29e-a575c8ee57fd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:41.274491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d47a2c26e044ebbd7c87d96a4ce37f', 'request_id': 'req-39ba4a41-6981-4fed-a29e-a575c8ee57fd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:41.288708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] The token cache is being invalidate because project 11d47a2c26e044ebbd7c87d96a4ce37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:51:41.289308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:41.290109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:51:41.292026 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1130/2281] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:51:40 2022] DELETE /identity/v3/projects/11d47a2c26e044ebbd7c87d96a4ce37f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:51:41.439813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:41.571908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:42.293774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059239-945b-4c8c-8aee-e16f06f47c81 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:42.294231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059239-945b-4c8c-8aee-e16f06f47c81 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:42.294659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059239-945b-4c8c-8aee-e16f06f47c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:42.355116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:42.368368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1f059239-945b-4c8c-8aee-e16f06f47c81 None None] MFA Rules not processed for user `fae5b787174b455ea56f9c409b3b1366`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:42.369278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1f059239-945b-4c8c-8aee-e16f06f47c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:42.450702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1152/2282] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:51:42.463015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:51:42.464985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:42.573289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:42.594484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4a41-6981-4fed-a29e-a575c8ee57fd admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:51:42.602818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2cda-2cc7-4e2f-81b4-37b9f2dc5338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:51:42.603592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2cda-2cc7-4e2f-81b4-37b9f2dc5338 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:42.603954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2cda-2cc7-4e2f-81b4-37b9f2dc5338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:42.604307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2cda-2cc7-4e2f-81b4-37b9f2dc5338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:42.614775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2cda-2cc7-4e2f-81b4-37b9f2dc5338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:51:42.616537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2cda-2cc7-4e2f-81b4-37b9f2dc5338 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:51:42.626572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1131/2283] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:51:43.137951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:43.669517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:44.217824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:44.414556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:51:44.414838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:51:44.415098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:51:44.425529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:44.438810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] MFA Rules not processed for user `fae5b787174b455ea56f9c409b3b1366`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:51:44.440959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:51:44.449067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1153/2284] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:51:44.732385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:45.079062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:45.715824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:46.451975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:46.698514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:47.207659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:47.270159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:47.397423 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:47.537932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:47.784896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:47.813146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:47.841118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:48.651829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:48.678966 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:49.108867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:49.137428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:49.366328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:49.732057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:50.155007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:59.463141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:52:00.532412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=13 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:52:07.560824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:07.561301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:07.561394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:07.580634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:07.582320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:07.644244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1132/2285] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:52:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:52:07.657736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:07.659135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:07.735853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ee3e7-6051-4c19-b3df-120209e16abb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:07.741697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f52f9-1f07-447a-87f7-6048e2d22b43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:07.742309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f52f9-1f07-447a-87f7-6048e2d22b43 service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:07.742579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f52f9-1f07-447a-87f7-6048e2d22b43 service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:07.742849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f52f9-1f07-447a-87f7-6048e2d22b43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:07.751365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f52f9-1f07-447a-87f7-6048e2d22b43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:07.753051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f52f9-1f07-447a-87f7-6048e2d22b43 service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:07.761528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1154/2286] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:52:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:52:08.467720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:08.469390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:08.540784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddc0f2-cc10-4ac3-ac9e-4f16c35d572f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:08.546368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:08.547144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:08.547534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:08.547880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:08.550671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:08.646160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:08.649946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:08.665912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1133/2287] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:52:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:52:17.758326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=32 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:52:18.660319 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=75 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:52:31.041723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7136cb-b3db-47d8-a297-11640c46435e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:31.042267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7136cb-b3db-47d8-a297-11640c46435e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:31.042267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7136cb-b3db-47d8-a297-11640c46435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:31.061690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1b7136cb-b3db-47d8-a297-11640c46435e None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:31.062857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1b7136cb-b3db-47d8-a297-11640c46435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:31.070504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1155/2288] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 28 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:52:31.085752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:31.097474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d321a58-0237-4738-8dbb-39a185e7d42c service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:31.102659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:31.103285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:31.103599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:31.103874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:31.112037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:31.113648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:31.121562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1134/2289] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:52:32.448006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:32.448588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:32.448588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:32.468759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:32.469940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:32.531350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1156/2290] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:52:32.558372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:32.559035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:32.632014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff565cc-7592-4612-ab4a-f7175934beaa service swift] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:32.637383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:32.637980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:32.638259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:32.638530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:32.647792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:32.649556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:32.659092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1135/2291] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:52:34.223753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:34.225239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:34.243352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0f0d2-fc6a-447c-b3a4-49ad4a0b948e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:34.248813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:34.249468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:34.249781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:34.250409 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] PATH_INFO: `/v3/users/696d5fdf3bae4dd5b33aa4bec27e87b6` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:34.251640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] RBAC: Authorizing `identity:delete_user(user_id=696d5fdf3bae4dd5b33aa4bec27e87b6)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:34.254272 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:34.418604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696d5fdf3bae4dd5b33aa4bec27e87b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:34.419233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696d5fdf3bae4dd5b33aa4bec27e87b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:34.431729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696d5fdf3bae4dd5b33aa4bec27e87b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:34.519840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696d5fdf3bae4dd5b33aa4bec27e87b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:34.520485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c44dcc67-0249-4b09-86e7-150595e4387b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696d5fdf3bae4dd5b33aa4bec27e87b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:34.533390 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1157/2292] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:52:34 2022] DELETE /identity/v3/users/696d5fdf3bae4dd5b33aa4bec27e87b6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:52:34.790634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:34.801027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c465-14de-4e8f-b67d-61384b88827e service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:34.866648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:34.866648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:34.866648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:34.866648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] PATH_INFO: `/v3/projects/2f0ffa6ba2124735a8b12131f1001511` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:34.867020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0ffa6ba2124735a8b12131f1001511)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:34.867993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:35.003358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0ffa6ba2124735a8b12131f1001511', 'request_id': 'req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:35.009948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0ffa6ba2124735a8b12131f1001511', 'request_id': 'req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:35.097418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0ffa6ba2124735a8b12131f1001511', 'request_id': 'req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:35.109083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] The token cache is being invalidate because project 2f0ffa6ba2124735a8b12131f1001511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:52:35.112911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:35.112911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:52:35.112911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1136/2293] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:52:34 2022] DELETE /identity/v3/projects/2f0ffa6ba2124735a8b12131f1001511 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:52:37.796208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a33711-59fd-4d59-ba77-9ffc0567a607 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:37.796659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a33711-59fd-4d59-ba77-9ffc0567a607 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:37.796659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a33711-59fd-4d59-ba77-9ffc0567a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:37.817391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d5a33711-59fd-4d59-ba77-9ffc0567a607 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:37.818668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d5a33711-59fd-4d59-ba77-9ffc0567a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:37.879436 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1158/2294] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:52:37.895321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:37.896857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:37.902118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:52:37.972809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16a2bb-c2f7-4b70-988d-1d8d5f89b138 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:37.978444 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:37.979053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:37.979337 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:37.979715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:37.988490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:37.990096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:38.000142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1137/2295] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:52:42.304650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef878-b74b-4aac-ab0d-e7c8d4e3eb89 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:42.305191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef878-b74b-4aac-ab0d-e7c8d4e3eb89 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:42.305191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ef878-b74b-4aac-ab0d-e7c8d4e3eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:42.322656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:52:42.328440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f00ef878-b74b-4aac-ab0d-e7c8d4e3eb89 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:42.329668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f00ef878-b74b-4aac-ab0d-e7c8d4e3eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:42.337799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1159/2296] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:52:42.354560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:42.356091 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:42.371098 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92587bd2-1ebe-49b3-a387-f60e6aec4a3a service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:42.376842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:42.377446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:42.377815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:42.378122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:42.387535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:42.389318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:42.399547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1138/2297] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:52:45.685579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4115-e3a7-4732-8f6f-7afd261dc389 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:45.686076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4115-e3a7-4732-8f6f-7afd261dc389 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:45.686176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4115-e3a7-4732-8f6f-7afd261dc389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:45.706085 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-2d6b4115-e3a7-4732-8f6f-7afd261dc389 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:45.707821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2d6b4115-e3a7-4732-8f6f-7afd261dc389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:45.765412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1160/2298] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:52:45.778673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:45.780290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:45.853046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40fda0-51ba-4531-a846-2fb178882f6e service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:45.858133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:45.858816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:45.859105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:45.859383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:45.868626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:45.870269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:45.879697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1139/2299] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:52:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:52:46.179366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c2820-3b2a-4251-ae16-10c1a3e5026f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:46.179682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c2820-3b2a-4251-ae16-10c1a3e5026f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:46.179960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c2820-3b2a-4251-ae16-10c1a3e5026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:46.204022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-276c2820-3b2a-4251-ae16-10c1a3e5026f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:46.205481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-276c2820-3b2a-4251-ae16-10c1a3e5026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:46.215098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1161/2300] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:52:46.251900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:46.268299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f55ac-6c2b-47fa-b881-1c17d4cdfcc9 service swift] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:46.290058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:46.290356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:46.290584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:46.291187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:46.311361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:46.312989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:46.327528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1140/2301] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:52:50.489252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542d209-64d6-4d78-ab4f-fa534a7d5714 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:50.490055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542d209-64d6-4d78-ab4f-fa534a7d5714 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:50.490332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542d209-64d6-4d78-ab4f-fa534a7d5714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:50.516635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0542d209-64d6-4d78-ab4f-fa534a7d5714 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:50.518296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0542d209-64d6-4d78-ab4f-fa534a7d5714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:50.531705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1162/2302] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:52:50.559892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:50.574861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49272c-cc0b-4136-9cb1-4d7ab97e6634 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:50.578621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:50.579254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:50.579578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:50.579850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:50.589417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:50.590980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:50.621199 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1141/2303] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:52:54.808270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370216df-7141-4324-b4d4-775767102a27 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:54.808817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370216df-7141-4324-b4d4-775767102a27 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:54.809361 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370216df-7141-4324-b4d4-775767102a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:54.838041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-370216df-7141-4324-b4d4-775767102a27 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:52:54.839344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-370216df-7141-4324-b4d4-775767102a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:52:54.849083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1163/2304] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:52:54.870075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:52:54.901020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fad3b-f9de-4dc7-b28c-67f68e171e54 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:52:54.908292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd8296-2612-405f-b89c-cfab09028b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:52:54.909070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd8296-2612-405f-b89c-cfab09028b1e service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:52:54.909466 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd8296-2612-405f-b89c-cfab09028b1e service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:52:54.909744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd8296-2612-405f-b89c-cfab09028b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:52:54.922999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd8296-2612-405f-b89c-cfab09028b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:52:54.924866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd8296-2612-405f-b89c-cfab09028b1e service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:52:54.937190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1142/2305] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:53:01.934674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370216df-7141-4324-b4d4-775767102a27 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:01.936736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-370216df-7141-4324-b4d4-775767102a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:02.080791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370216df-7141-4324-b4d4-775767102a27 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:02.097115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d93653-579b-46e5-8667-8cf2ced775ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:02.100410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d93653-579b-46e5-8667-8cf2ced775ee service placement] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:02.100538 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d93653-579b-46e5-8667-8cf2ced775ee service placement] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:02.100998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d93653-579b-46e5-8667-8cf2ced775ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:02.103706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-58d93653-579b-46e5-8667-8cf2ced775ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:02.132981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d93653-579b-46e5-8667-8cf2ced775ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:02.134684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d93653-579b-46e5-8667-8cf2ced775ee service placement] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:02.167749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1164/2306] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:53:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:53:04.931925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:04.956141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161f388-3526-4899-b377-660a6a615994 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:04.956412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161f388-3526-4899-b377-660a6a615994 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:04.961613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161f388-3526-4899-b377-660a6a615994 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:04.961613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1143/2307] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:53:04.964629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aca6e-2ac0-4f7c-b872-6cf92a8ad07b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:04.965096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aca6e-2ac0-4f7c-b872-6cf92a8ad07b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:04.965337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aca6e-2ac0-4f7c-b872-6cf92a8ad07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:04.987486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-431aca6e-2ac0-4f7c-b872-6cf92a8ad07b None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:04.989016 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-431aca6e-2ac0-4f7c-b872-6cf92a8ad07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:05.000298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1165/2308] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:53:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:53:05.016689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161f388-3526-4899-b377-660a6a615994 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:05.018504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f161f388-3526-4899-b377-660a6a615994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:05.075491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161f388-3526-4899-b377-660a6a615994 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:05.078995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f7b29-dd57-4d60-a144-8df0623c84e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:05.079618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7b29-dd57-4d60-a144-8df0623c84e0 service glance] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:05.079901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7b29-dd57-4d60-a144-8df0623c84e0 service glance] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:05.080174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7b29-dd57-4d60-a144-8df0623c84e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:05.090700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f7b29-dd57-4d60-a144-8df0623c84e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:05.092388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f7b29-dd57-4d60-a144-8df0623c84e0 service glance] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:05.102990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1144/2309] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:53:05.299173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604960-c05e-4d73-8b62-3235716112e8 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:05.299704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604960-c05e-4d73-8b62-3235716112e8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:05.300364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604960-c05e-4d73-8b62-3235716112e8 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:05.302326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1166/2310] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:53:05.307352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747772-355c-4e2c-bc6a-1b44da110956 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:05.307688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747772-355c-4e2c-bc6a-1b44da110956 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:05.307990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747772-355c-4e2c-bc6a-1b44da110956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:05.328752 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-31747772-355c-4e2c-bc6a-1b44da110956 None None] MFA Rules not processed for user `5523644021bf4d91a3a9246bee763b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:05.330240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-31747772-355c-4e2c-bc6a-1b44da110956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:05.385322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1145/2311] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:05.397096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604960-c05e-4d73-8b62-3235716112e8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:05.398786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2a604960-c05e-4d73-8b62-3235716112e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:05.412113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604960-c05e-4d73-8b62-3235716112e8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:05.415736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e331d-dd48-40bf-bc43-b9a14d51ee56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:05.416332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e331d-dd48-40bf-bc43-b9a14d51ee56 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:05.416608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e331d-dd48-40bf-bc43-b9a14d51ee56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:05.416883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e331d-dd48-40bf-bc43-b9a14d51ee56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:05.423834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e331d-dd48-40bf-bc43-b9a14d51ee56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:05.425243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e331d-dd48-40bf-bc43-b9a14d51ee56 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:05.433584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1167/2312] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:53:05.516332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1cda7-f59c-4cc3-bae9-83093d88b795 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:05.516623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1cda7-f59c-4cc3-bae9-83093d88b795 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:05.516904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1cda7-f59c-4cc3-bae9-83093d88b795 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:05.518306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1146/2313] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:53:05.524468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de03369-33d3-4d2f-a691-0829926183cd None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:05.524752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de03369-33d3-4d2f-a691-0829926183cd None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:05.525021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de03369-33d3-4d2f-a691-0829926183cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:05.545637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-2de03369-33d3-4d2f-a691-0829926183cd None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:05.546815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2de03369-33d3-4d2f-a691-0829926183cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:05.557377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1168/2314] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:05.568697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1cda7-f59c-4cc3-bae9-83093d88b795 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:05.570356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1bd1cda7-f59c-4cc3-bae9-83093d88b795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:05.584794 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1cda7-f59c-4cc3-bae9-83093d88b795 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:05.588533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:05.589139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:05.589419 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:05.589694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:05.601887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:05.603304 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:05.616620 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1147/2315] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:53:15.540797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=78 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:15.609490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=55 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:15.762507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e79d-ddff-4fb7-b4e0-e22b565bcad2 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:15.763059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e79d-ddff-4fb7-b4e0-e22b565bcad2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:15.763453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e79d-ddff-4fb7-b4e0-e22b565bcad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:15.792858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a0e9e79d-ddff-4fb7-b4e0-e22b565bcad2 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:15.794238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a0e9e79d-ddff-4fb7-b4e0-e22b565bcad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:15.809497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1169/2316] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:53:15.828938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:15.846870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbebf34-1a20-43b6-8f44-7e8e9936e421 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:15.854512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff8bc9-7c3b-4fa4-851e-e289a5b2ec03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:15.855246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8bc9-7c3b-4fa4-851e-e289a5b2ec03 service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:15.855622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8bc9-7c3b-4fa4-851e-e289a5b2ec03 service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:15.860303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8bc9-7c3b-4fa4-851e-e289a5b2ec03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:15.866368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8bc9-7c3b-4fa4-851e-e289a5b2ec03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:15.868057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8bc9-7c3b-4fa4-851e-e289a5b2ec03 service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:15.903990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1148/2317] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:53:16.965768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d836e24-8162-4fc6-ab37-3a833e8b5864 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:16.966489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d836e24-8162-4fc6-ab37-3a833e8b5864 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:16.966643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d836e24-8162-4fc6-ab37-3a833e8b5864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:17.003998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-3d836e24-8162-4fc6-ab37-3a833e8b5864 None None] MFA Rules not processed for user `fae5b787174b455ea56f9c409b3b1366`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:17.007153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3d836e24-8162-4fc6-ab37-3a833e8b5864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:17.133868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1170/2318] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:53:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:25.873906 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=6 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:27.115655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=28 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:31.059594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a9cc-a54e-42fe-8a81-cc7f9b54ab8d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:31.060146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a9cc-a54e-42fe-8a81-cc7f9b54ab8d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:31.060146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a9cc-a54e-42fe-8a81-cc7f9b54ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:31.090146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ce83a9cc-a54e-42fe-8a81-cc7f9b54ab8d None None] MFA Rules not processed for user `86312e5441df4cf89028fbe807bef5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:31.090146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ce83a9cc-a54e-42fe-8a81-cc7f9b54ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:31.153455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1149/2319] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:33.623250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb0b87-eb24-4f5a-bef5-0c138d243240 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:33.623813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb0b87-eb24-4f5a-bef5-0c138d243240 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:33.624649 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb0b87-eb24-4f5a-bef5-0c138d243240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:33.652732 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-63fb0b87-eb24-4f5a-bef5-0c138d243240 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:33.655792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-63fb0b87-eb24-4f5a-bef5-0c138d243240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:33.667378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1171/2320] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 28 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:33.694206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a9cc-a54e-42fe-8a81-cc7f9b54ab8d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:33.702659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a9cc-a54e-42fe-8a81-cc7f9b54ab8d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:33.709255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787de56-ba4b-4167-ade0-8d1df679ec29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:33.710491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787de56-ba4b-4167-ade0-8d1df679ec29 service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:33.710826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787de56-ba4b-4167-ade0-8d1df679ec29 service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:33.711105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787de56-ba4b-4167-ade0-8d1df679ec29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:33.721069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787de56-ba4b-4167-ade0-8d1df679ec29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:33.724175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787de56-ba4b-4167-ade0-8d1df679ec29 service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:33.732481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1150/2321] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:53:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:53:35.432462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1dbc-71e0-4fe2-a8b9-9ec606d9f3f6 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:35.433412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1dbc-71e0-4fe2-a8b9-9ec606d9f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:35.434232 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1dbc-71e0-4fe2-a8b9-9ec606d9f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:35.455598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c7fa1dbc-71e0-4fe2-a8b9-9ec606d9f3f6 None None] MFA Rules not processed for user `0150a12ff77b433496b370fa47f0dbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:35.457237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c7fa1dbc-71e0-4fe2-a8b9-9ec606d9f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:35.516625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1172/2322] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:43.728692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=31 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:45.509667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=28 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:52.200968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203f157-b5f5-45bb-a6a3-32139587d7b5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:52.201430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203f157-b5f5-45bb-a6a3-32139587d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:52.201555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203f157-b5f5-45bb-a6a3-32139587d7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:52.236343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5203f157-b5f5-45bb-a6a3-32139587d7b5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:52.238348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5203f157-b5f5-45bb-a6a3-32139587d7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:52.248132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1151/2323] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:52.266028 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1dbc-71e0-4fe2-a8b9-9ec606d9f3f6 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:52.281479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1dbc-71e0-4fe2-a8b9-9ec606d9f3f6 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:52.286416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737323bc-2b64-475e-8648-0f821a7b3df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:52.287084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737323bc-2b64-475e-8648-0f821a7b3df8 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:52.287366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737323bc-2b64-475e-8648-0f821a7b3df8 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:52.287679 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737323bc-2b64-475e-8648-0f821a7b3df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:52.298981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737323bc-2b64-475e-8648-0f821a7b3df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:52.300610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737323bc-2b64-475e-8648-0f821a7b3df8 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:52.315974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1173/2324] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:53:55.598649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8674d-bccc-455f-a595-10eef378a65f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:55.598649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8674d-bccc-455f-a595-10eef378a65f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:55.598649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8674d-bccc-455f-a595-10eef378a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:55.614911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-bbb8674d-bccc-455f-a595-10eef378a65f None None] MFA Rules not processed for user `ef12fbaea8c14f548429b3733840ceeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:55.616143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bbb8674d-bccc-455f-a595-10eef378a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:55.673139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1152/2325] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:55.858204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202bdb1-504b-4294-a08b-44ad7f273c43 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:55.858751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202bdb1-504b-4294-a08b-44ad7f273c43 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:55.858751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202bdb1-504b-4294-a08b-44ad7f273c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:55.879599 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1202bdb1-504b-4294-a08b-44ad7f273c43 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:55.881581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1202bdb1-504b-4294-a08b-44ad7f273c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:55.890053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1174/2326] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:55.904689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8674d-bccc-455f-a595-10eef378a65f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:55.920024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8674d-bccc-455f-a595-10eef378a65f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:55.925528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:55.926141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:55.926425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:55.926701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:55.937382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:55.939122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:55.949370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1153/2327] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:53:58.574511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9e1f-0510-4fe7-b88d-feb486aa3b77 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:58.574914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9e1f-0510-4fe7-b88d-feb486aa3b77 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:58.575170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9e1f-0510-4fe7-b88d-feb486aa3b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:58.596339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b63b9e1f-0510-4fe7-b88d-feb486aa3b77 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:53:58.597556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b63b9e1f-0510-4fe7-b88d-feb486aa3b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:53:58.607298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1175/2328] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:53:58.630516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:53:58.642162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a29841-6213-4b8f-ac2b-58d5b1332d49 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:53:58.652894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:53:58.653600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:53:58.654331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:53:58.654331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:53:58.663132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:53:58.664723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:53:58.675294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1154/2329] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:02.854598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91407686-8e84-459c-b535-1469818d40e0 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:02.855151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91407686-8e84-459c-b535-1469818d40e0 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:02.855151 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91407686-8e84-459c-b535-1469818d40e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:02.876561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-91407686-8e84-459c-b535-1469818d40e0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:54:02.877898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-91407686-8e84-459c-b535-1469818d40e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:02.887143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1176/2330] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:54:02.903541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:02.915021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc77d98-904f-41b3-a704-8cd06754c7c7 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:02.921571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:02.922180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:02.922463 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:02.922741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:02.931281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:02.933815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:02.943893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1155/2331] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:10.180123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b6fa8-4948-47b9-99a5-1756d3f67c0d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:10.180651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b6fa8-4948-47b9-99a5-1756d3f67c0d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:10.180651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b6fa8-4948-47b9-99a5-1756d3f67c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:10.201100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-795b6fa8-4948-47b9-99a5-1756d3f67c0d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:54:10.202302 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-795b6fa8-4948-47b9-99a5-1756d3f67c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:10.210279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1177/2332] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Sep 28 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:54:10.233573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:10.244539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c5010-6b25-4250-872c-eb3255b4faee service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:10.250854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:10.251517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:10.251800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:10.252162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:10.260529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:10.262095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:10.271681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1156/2333] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:20.195666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=18 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:20.267350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=52 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:22.085513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b6fa8-4948-47b9-99a5-1756d3f67c0d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:22.095863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b6fa8-4948-47b9-99a5-1756d3f67c0d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:22.099639 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65281970-8cab-4779-8d1d-16519aad056f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:22.100242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65281970-8cab-4779-8d1d-16519aad056f service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:22.100525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65281970-8cab-4779-8d1d-16519aad056f service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:22.100800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65281970-8cab-4779-8d1d-16519aad056f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:22.102532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-65281970-8cab-4779-8d1d-16519aad056f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:22.115916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65281970-8cab-4779-8d1d-16519aad056f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:22.117369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65281970-8cab-4779-8d1d-16519aad056f service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:22.128291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1178/2334] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:23.314656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:23.323866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a51f5-a507-4248-8e25-da6dba4fd6ad service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:23.328480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:23.329078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:23.329359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:23.329632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:23.331414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:23.346185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:23.347627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:23.359341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1157/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:32.123410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=6 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:33.353999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=6 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:33.870292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e46e73-cefd-49e3-bd27-a7e1269bb26e None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:33.874915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e46e73-cefd-49e3-bd27-a7e1269bb26e None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:33.874915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e46e73-cefd-49e3-bd27-a7e1269bb26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:33.895142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-53e46e73-cefd-49e3-bd27-a7e1269bb26e None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:54:33.896772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-53e46e73-cefd-49e3-bd27-a7e1269bb26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:33.906462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1179/2336] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 28 08:54:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:54:34.033599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:34.049925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecce79-04bb-4b41-b2cd-ba3122473b9c service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:34.069401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:34.069401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:34.069401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:34.069401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:34.070268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:34.071101 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:34.084542 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1158/2337] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:54:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:54:35.570835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e46e73-cefd-49e3-bd27-a7e1269bb26e None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:35.586753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e46e73-cefd-49e3-bd27-a7e1269bb26e None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:35.596455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f453d-8c62-4f5f-a56e-7795a150f427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:35.597338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f453d-8c62-4f5f-a56e-7795a150f427 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:35.597618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f453d-8c62-4f5f-a56e-7795a150f427 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:35.597920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f453d-8c62-4f5f-a56e-7795a150f427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:35.602134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5a1f453d-8c62-4f5f-a56e-7795a150f427 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:35.624606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f453d-8c62-4f5f-a56e-7795a150f427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:35.629176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f453d-8c62-4f5f-a56e-7795a150f427 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:35.657804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1180/2338] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:38.692609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:38.706571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5bbb-e9bb-427e-a6df-8a56e7b20363 service swift] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:38.713758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:38.715369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:38.715689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:38.716319 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:38.718164 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:38.729478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:38.731915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:38.741734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1159/2339] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:41.641911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:41.643321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:41.643806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:41.678579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] MFA Rules not processed for user `24ae810cf4bf4014bc455d4653eb77f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:54:41.679811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:41.737944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1181/2340] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:54:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:54:42.514437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:42.523578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbfb47-d8d2-4eef-bd94-a375f4c68922 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:42.527247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:42.527891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:42.528178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:42.528457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:42.530188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:42.540058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:42.541572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:42.551005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1160/2341] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:43.229289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:43.229289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:43.244949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50533b16-f282-49f3-9636-87815720c4b7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:43.252349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:43.253078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:43.253457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:43.253830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:43.256177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:43.270724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:43.272930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:43.283795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1182/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:45.541970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:45.552212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0c34d-f347-4d55-8eb8-44982428813b service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:45.557237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:45.558499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:45.558769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:45.559118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:45.561097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:45.574600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:45.576148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:45.586386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1161/2343] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:45.646563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:45.648008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:45.661558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ccae-224f-4478-9be8-154562561a9f service placement] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:45.666037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:45.666660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:45.666941 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:45.667248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] PATH_INFO: `/v3/users/33eafdd0753c43bb95584a2c6e578407` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:45.668415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33eafdd0753c43bb95584a2c6e578407)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:45.670392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:45.925798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33eafdd0753c43bb95584a2c6e578407'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:45.927940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33eafdd0753c43bb95584a2c6e578407'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:45.950445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33eafdd0753c43bb95584a2c6e578407'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.080873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33eafdd0753c43bb95584a2c6e578407'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.081940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33eafdd0753c43bb95584a2c6e578407'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.108025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1183/2344] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:54:45 2022] DELETE /identity/v3/users/33eafdd0753c43bb95584a2c6e578407 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:54:46.404492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:46.415135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be6af9-908f-41a4-81f5-7e69e64ada32 service placement] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:46.497480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:46.498114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:46.498388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:46.499233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] PATH_INFO: `/v3/projects/8a37a3f685a24e3ca3b0ac1b864aa0f0` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:46.500478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a37a3f685a24e3ca3b0ac1b864aa0f0)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:46.502347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:46.636472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a37a3f685a24e3ca3b0ac1b864aa0f0', 'request_id': 'req-22243c79-6f75-461a-8b6e-bf946b03d362'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.643436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a37a3f685a24e3ca3b0ac1b864aa0f0', 'request_id': 'req-22243c79-6f75-461a-8b6e-bf946b03d362'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.719746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a37a3f685a24e3ca3b0ac1b864aa0f0', 'request_id': 'req-22243c79-6f75-461a-8b6e-bf946b03d362'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.731680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] The token cache is being invalidate because project 8a37a3f685a24e3ca3b0ac1b864aa0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:54:46.732053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.732779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:46.734325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1162/2345] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:54:46 2022] DELETE /identity/v3/projects/8a37a3f685a24e3ca3b0ac1b864aa0f0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:54:46.738303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:46.739846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:46.754493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb782fcf-95df-469e-8354-1417adf105a6 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:46.815889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:46.833276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:46.838407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:46.838407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:46.838407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] PATH_INFO: `/v3/users/6b6f9b0e8991496c9d3f9060b893e0bf` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:46.838407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6f9b0e8991496c9d3f9060b893e0bf)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:46.838407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:47.110452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6f9b0e8991496c9d3f9060b893e0bf'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.111144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6f9b0e8991496c9d3f9060b893e0bf'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.123149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6f9b0e8991496c9d3f9060b893e0bf'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.194712 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6f9b0e8991496c9d3f9060b893e0bf'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.195335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6f9b0e8991496c9d3f9060b893e0bf'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.208221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1184/2346] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:54:46 2022] DELETE /identity/v3/users/6b6f9b0e8991496c9d3f9060b893e0bf => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:54:47.447376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:47.450078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:47.466154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243c79-6f75-461a-8b6e-bf946b03d362 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:47.502146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:47.525671 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:47.526300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:47.527284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:47.527602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] PATH_INFO: `/v3/projects/2584d3bfdd4c4c25892cef6024c13bc9` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:47.528712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2584d3bfdd4c4c25892cef6024c13bc9)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:47.530605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:47.633952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2584d3bfdd4c4c25892cef6024c13bc9', 'request_id': 'req-b22005eb-423e-4031-80c3-543cf877e683'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.640989 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2584d3bfdd4c4c25892cef6024c13bc9', 'request_id': 'req-b22005eb-423e-4031-80c3-543cf877e683'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.719121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2584d3bfdd4c4c25892cef6024c13bc9', 'request_id': 'req-b22005eb-423e-4031-80c3-543cf877e683'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.730147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] The token cache is being invalidate because project 2584d3bfdd4c4c25892cef6024c13bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:54:47.730402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.731031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:47.732541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1163/2347] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:54:47 2022] DELETE /identity/v3/projects/2584d3bfdd4c4c25892cef6024c13bc9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:54:51.389781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:51.391856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:51.466491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c8a2-864f-45da-bc74-d15154a12df3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:51.560403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:51.561037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:51.561313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:51.561576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:51.574421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:51.586247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:51.588070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:51.600228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1185/2348] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:52.561843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:52.564342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:52.632087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22005eb-423e-4031-80c3-543cf877e683 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:52.637761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:52.638580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:52.638742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:52.639049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] PATH_INFO: `/v3/users/fae5b787174b455ea56f9c409b3b1366` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:52.640277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae5b787174b455ea56f9c409b3b1366)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:52.642370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:52.861884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae5b787174b455ea56f9c409b3b1366'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:52.862676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae5b787174b455ea56f9c409b3b1366'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:52.881255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae5b787174b455ea56f9c409b3b1366'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:52.885240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:53.005076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae5b787174b455ea56f9c409b3b1366'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:53.005747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae5b787174b455ea56f9c409b3b1366'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:53.019690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1164/2349] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:54:52 2022] DELETE /identity/v3/users/fae5b787174b455ea56f9c409b3b1366 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:54:53.303100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:53.316391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bd570-9532-4f80-9913-13c21a2fadb7 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:53.336993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:53.502007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:53.502623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:53.502902 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:53.503182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] PATH_INFO: `/v3/projects/42a5362177fa4486ac94a9bd7c49d88c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:53.504354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a5362177fa4486ac94a9bd7c49d88c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:53.506429 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:53.651951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a5362177fa4486ac94a9bd7c49d88c', 'request_id': 'req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:53.659368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a5362177fa4486ac94a9bd7c49d88c', 'request_id': 'req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:53.785104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a5362177fa4486ac94a9bd7c49d88c', 'request_id': 'req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:53.802014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] The token cache is being invalidate because project 42a5362177fa4486ac94a9bd7c49d88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:54:53.802358 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:53.803021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:53.804764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1186/2350] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:54:53 2022] DELETE /identity/v3/projects/42a5362177fa4486ac94a9bd7c49d88c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:54:55.033256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:55.034738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:55.099529 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5198a-1bd3-42f2-b15b-ba23a7e63ad8 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:55.158922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:55.159944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:55.160450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:55.160923 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:55.162954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:55.194178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:55.196213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:55.248859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:55.250357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:55.262571 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1165/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:55.285354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86212f4e-e3f8-4e20-95cd-bbc3fb908c56 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:55.290914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:55.291626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:55.292011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:55.292513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:55.294316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:55.306984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:55.309748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:55.321546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1187/2352] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:54:58.646067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:58.666195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7b1f-2e4d-4147-8d00-cdca3547857d service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:58.679104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:58.680835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:58.687299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:58.687299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:58.707900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:58.790623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:58.802691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:58.804709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:58.815353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1166/2353] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:59.387179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:59.387179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:59.473187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:59.516401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c327cb1-dae1-40f3-ab54-be280c6689f3 service nova] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:59.522213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:59.522856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:59.523315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:59.523619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:59.526950 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:59.537533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:59.539207 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:59.550416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1188/2354] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:54:59.595140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:54:59.596744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:54:59.626169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994ced-5885-48ef-9212-99a4fde10519 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:54:59.637818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:54:59.638357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:54:59.638678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:54:59.638909 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] PATH_INFO: `/v3/users/86312e5441df4cf89028fbe807bef5b5` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:54:59.640302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86312e5441df4cf89028fbe807bef5b5)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:54:59.643080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:54:59.833487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86312e5441df4cf89028fbe807bef5b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:59.834636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86312e5441df4cf89028fbe807bef5b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:59.851985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86312e5441df4cf89028fbe807bef5b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:59.924226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86312e5441df4cf89028fbe807bef5b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:59.925341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e441ec78-1fae-4858-82bf-b4a3f912bfa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86312e5441df4cf89028fbe807bef5b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:54:59.940900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1167/2355] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:54:59 2022] DELETE /identity/v3/users/86312e5441df4cf89028fbe807bef5b5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:00.207114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:00.217525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac2046-ca0c-4278-be8c-a3edfc424f1c service placement] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:00.277406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:00.278034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:00.278341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:00.278611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] PATH_INFO: `/v3/projects/71df24eaf2a242fa8e1cb24ec756f11a` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:00.279740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71df24eaf2a242fa8e1cb24ec756f11a)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:00.281630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:00.410795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71df24eaf2a242fa8e1cb24ec756f11a', 'request_id': 'req-f08863ac-13b5-496f-b8c4-a365606e3bb8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:00.417170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71df24eaf2a242fa8e1cb24ec756f11a', 'request_id': 'req-f08863ac-13b5-496f-b8c4-a365606e3bb8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:00.502193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71df24eaf2a242fa8e1cb24ec756f11a', 'request_id': 'req-f08863ac-13b5-496f-b8c4-a365606e3bb8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:00.514042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] The token cache is being invalidate because project 71df24eaf2a242fa8e1cb24ec756f11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:00.515202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:00.515202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-f08863ac-13b5-496f-b8c4-a365606e3bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:00.516760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1189/2356] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:00 2022] DELETE /identity/v3/projects/71df24eaf2a242fa8e1cb24ec756f11a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:00.521893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceef7fd-d11c-44bc-906d-dc1a0d66cc40 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:00.522265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceef7fd-d11c-44bc-906d-dc1a0d66cc40 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:00.522617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceef7fd-d11c-44bc-906d-dc1a0d66cc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:00.546726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3ceef7fd-d11c-44bc-906d-dc1a0d66cc40 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:00.547982 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3ceef7fd-d11c-44bc-906d-dc1a0d66cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:00.617198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1168/2357] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:00.625484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50a058-b509-4a78-9974-30eb099dec35 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:00.625769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50a058-b509-4a78-9974-30eb099dec35 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:00.626040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50a058-b509-4a78-9974-30eb099dec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:00.647615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8a50a058-b509-4a78-9974-30eb099dec35 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:00.649035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8a50a058-b509-4a78-9974-30eb099dec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:00.659376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1190/2358] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:00.663238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceef7fd-d11c-44bc-906d-dc1a0d66cc40 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:00.675062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceef7fd-d11c-44bc-906d-dc1a0d66cc40 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:00.681329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:00.682772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:00.687537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:00.687537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:00.687537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:00.687537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:00.687537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:00.700675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1169/2359] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:55:00.704740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50a058-b509-4a78-9974-30eb099dec35 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:00.715136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50a058-b509-4a78-9974-30eb099dec35 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:00.720233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:00.721106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:00.721384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:00.721653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:00.722321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:00.724424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:00.829203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1191/2360] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:00 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:00.833518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:00.844810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833d5a4-d94d-4edb-ad4e-acf9778049c0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:00.894931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:00.932327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:00.933712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:00.934000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:00.934278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:00.934939 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:00.936959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:01.040237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1170/2361] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:00 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:01.043099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:01.063299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2856ce3-5efa-4eee-8a2c-5bf5a5904fc9 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:01.068701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:01.069315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:01.069598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:01.069866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:01.070511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:01.072376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:01.082673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1192/2362] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:01.086756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:01.098568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99d595-bb77-465f-b59f-0f3ca1593185 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:01.105018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cecb9-b3b7-4812-923d-63c9c4320d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:01.109690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cecb9-b3b7-4812-923d-63c9c4320d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:01.109690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cecb9-b3b7-4812-923d-63c9c4320d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:01.109690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cecb9-b3b7-4812-923d-63c9c4320d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:01.109690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cecb9-b3b7-4812-923d-63c9c4320d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:01.109690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cecb9-b3b7-4812-923d-63c9c4320d92 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:01.121564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1171/2363] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:55:01.125815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:01.137746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b72d4c-f631-4e30-b31f-26150f2b57b3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:01.142634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a9679-b1fc-495a-94df-12bf397d9cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:01.143542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a9679-b1fc-495a-94df-12bf397d9cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:01.143946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a9679-b1fc-495a-94df-12bf397d9cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:01.144289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a9679-b1fc-495a-94df-12bf397d9cc4 admin admin] PATH_INFO: `/v3/projects/a0584a525c374cc4984d4a2f7a6cdae0/users/0aaa3e62a6114966979913fc46b047f9/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:01.160219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a9679-b1fc-495a-94df-12bf397d9cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0584a525c374cc4984d4a2f7a6cdae0, user_id=0aaa3e62a6114966979913fc46b047f9, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:01.162917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a9679-b1fc-495a-94df-12bf397d9cc4 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:01.165277 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:01.251387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1193/2364] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:01 2022] PUT /identity/v3/projects/a0584a525c374cc4984d4a2f7a6cdae0/users/0aaa3e62a6114966979913fc46b047f9/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:01.264001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:01.264257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:01.264449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:01.302115 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] MFA Rules not processed for user `0aaa3e62a6114966979913fc46b047f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:01.303243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:01.369160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1172/2365] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:01.372734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:01.373194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:01.373487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:01.380094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:01.381508 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:01.394070 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] MFA Rules not processed for user `0150a12ff77b433496b370fa47f0dbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:01.395395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:01.439300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9db4d-599b-47a1-bfcd-7a9aa0440c8c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:01.442955 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:01.443599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:01.443881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:01.444160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:01.453346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:01.454824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:01.455320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1194/2366] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:01.465377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1173/2367] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:01.791107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:01.793848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:01.850220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37313898-4e63-4ebb-ba59-5fb847ee1da2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:01.853865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2271e-4bb1-45dc-8721-db464bf4cfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:01.855398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2271e-4bb1-45dc-8721-db464bf4cfad service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:01.855706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2271e-4bb1-45dc-8721-db464bf4cfad service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:01.855990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2271e-4bb1-45dc-8721-db464bf4cfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:01.857761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-28f2271e-4bb1-45dc-8721-db464bf4cfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:01.867153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2271e-4bb1-45dc-8721-db464bf4cfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:01.868610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2271e-4bb1-45dc-8721-db464bf4cfad service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:01.878638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1195/2368] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:11.472528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:11.536734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4047460-c976-45a0-a3a1-68b365d8c6ae service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:11.541191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:11.541840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:11.542106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:11.542428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] PATH_INFO: `/v3/users/0aaa3e62a6114966979913fc46b047f9` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:11.543791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aaa3e62a6114966979913fc46b047f9)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:11.546189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:11.548330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:11.707888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aaa3e62a6114966979913fc46b047f9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:11.708564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aaa3e62a6114966979913fc46b047f9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:11.723609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aaa3e62a6114966979913fc46b047f9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:11.796379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aaa3e62a6114966979913fc46b047f9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:11.796379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aaa3e62a6114966979913fc46b047f9'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:11.808477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1174/2369] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:11 2022] DELETE /identity/v3/users/0aaa3e62a6114966979913fc46b047f9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:11.813360 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:11.813807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:11.813928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:11.834190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:11.835392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:11.899949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1196/2370] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:11.911984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:11.913749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:11.976449 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cc4d5-f6f3-4b23-bab4-60de3e29bd17 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:11.980472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48965d-8ce4-47ab-9486-a4d64d8edab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:11.981273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48965d-8ce4-47ab-9486-a4d64d8edab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:11.985848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48965d-8ce4-47ab-9486-a4d64d8edab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:11.985848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48965d-8ce4-47ab-9486-a4d64d8edab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:11.992875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48965d-8ce4-47ab-9486-a4d64d8edab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:11.994293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48965d-8ce4-47ab-9486-a4d64d8edab0 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:12.005138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1175/2371] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:12.480701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:12.482328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:12.495957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c152a85-1d9f-46c1-9f91-28f7d5f36b20 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:12.502239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:12.503004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:12.503280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:12.504017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] PATH_INFO: `/v3/projects/a0584a525c374cc4984d4a2f7a6cdae0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:12.505449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0584a525c374cc4984d4a2f7a6cdae0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:12.508231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:12.625278 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:12.633694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0584a525c374cc4984d4a2f7a6cdae0', 'request_id': 'req-7c44c90a-8fec-4d0c-afe1-053257306db6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:12.640831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0584a525c374cc4984d4a2f7a6cdae0', 'request_id': 'req-7c44c90a-8fec-4d0c-afe1-053257306db6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:12.712475 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0584a525c374cc4984d4a2f7a6cdae0', 'request_id': 'req-7c44c90a-8fec-4d0c-afe1-053257306db6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:12.723202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] The token cache is being invalidate because project a0584a525c374cc4984d4a2f7a6cdae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:12.723525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:12.724142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7c44c90a-8fec-4d0c-afe1-053257306db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:12.725601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1197/2372] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:12 2022] DELETE /identity/v3/projects/a0584a525c374cc4984d4a2f7a6cdae0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:12.730693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c46c-af31-46e9-8447-78e8203d81b3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:12.731169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c46c-af31-46e9-8447-78e8203d81b3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:12.731267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c46c-af31-46e9-8447-78e8203d81b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:12.751138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-cb01c46c-af31-46e9-8447-78e8203d81b3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:12.752443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cb01c46c-af31-46e9-8447-78e8203d81b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:12.814052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1176/2373] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:12.821830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f6a1-616b-40b0-81c9-d2abb72fc5a9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:12.822343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f6a1-616b-40b0-81c9-d2abb72fc5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:12.822343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f6a1-616b-40b0-81c9-d2abb72fc5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:12.845213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4304f6a1-616b-40b0-81c9-d2abb72fc5a9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:12.846552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4304f6a1-616b-40b0-81c9-d2abb72fc5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:12.855265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1198/2374] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:12.859672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01c46c-af31-46e9-8447-78e8203d81b3 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:12.869734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01c46c-af31-46e9-8447-78e8203d81b3 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:12.875074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:12.877973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:12.877973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:12.877973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:12.877973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:12.877973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:12.878960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:12.891121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1177/2375] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:12.895763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f6a1-616b-40b0-81c9-d2abb72fc5a9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:12.906442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f6a1-616b-40b0-81c9-d2abb72fc5a9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:12.911349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:12.911986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:12.912423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:12.912701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:12.913388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:12.915290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.040622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1199/2376] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:12 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:13.045210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.055243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6b11b-aed1-470a-9131-7a762a2eea38 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.063585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:13.113875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.114476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.114754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.115024 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.115684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.117563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.193261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1178/2377] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:13 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:13.200677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.211911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373a98-3706-46f1-b7b2-ef6652c0568b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.218076 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.218684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.218963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.219238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.219942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.221628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.231857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1200/2378] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:13.235865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.246339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f253725-f856-4e00-bdf3-c22e341441c1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.250903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.251535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.251817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.252087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.252804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.257875 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.265652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1179/2379] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:13.269801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.279719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26bafb-48da-4fe8-b697-583f3d185d58 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.284474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58b19d-6b57-4a19-9f13-1e1aaa790e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.285156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58b19d-6b57-4a19-9f13-1e1aaa790e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.290448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58b19d-6b57-4a19-9f13-1e1aaa790e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.290448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58b19d-6b57-4a19-9f13-1e1aaa790e8a admin admin] PATH_INFO: `/v3/projects/687d6bb7373b44d1aee0f7b2e83377d5/users/1627f2a48472401f958619197062813e/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.302879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58b19d-6b57-4a19-9f13-1e1aaa790e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=687d6bb7373b44d1aee0f7b2e83377d5, user_id=1627f2a48472401f958619197062813e, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.305575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.307275 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:13.310617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58b19d-6b57-4a19-9f13-1e1aaa790e8a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.385039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2007157-543b-460b-b65a-01502d06fe4a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.391203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.391761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.392039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.392305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.394062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:13.410398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1201/2380] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:13 2022] PUT /identity/v3/projects/687d6bb7373b44d1aee0f7b2e83377d5/users/1627f2a48472401f958619197062813e/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:13.412215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.414141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.420886 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213b533-87d5-4ba2-99d6-b5b712ec7461 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.421172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213b533-87d5-4ba2-99d6-b5b712ec7461 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.421442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213b533-87d5-4ba2-99d6-b5b712ec7461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.428474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1180/2381] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:13.458710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c213b533-87d5-4ba2-99d6-b5b712ec7461 None None] MFA Rules not processed for user `1627f2a48472401f958619197062813e`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:13.459955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c213b533-87d5-4ba2-99d6-b5b712ec7461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:13.526253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1202/2382] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:13.530920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.541324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f4f8-15a7-4412-b5ff-28fc935fa8c2 service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.599700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.600311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.600589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.600859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.601497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.603363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.696900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:13.703879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1181/2383] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:13 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:13.708045 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213b533-87d5-4ba2-99d6-b5b712ec7461 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.722284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213b533-87d5-4ba2-99d6-b5b712ec7461 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.768792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:13.778828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.779461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.779748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.780025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.783664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.783664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.866242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1203/2384] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:13 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:13.870313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.881871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677176e6-c822-46e4-8aaf-f4001d3ebd2c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.886493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.887798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.888117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.888489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.889077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.890635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:13.901181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1182/2385] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:13.905275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:13.915542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadb7b4-6b87-4466-9d84-5e97c7a22365 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:13.920192 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:13.920850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:13.921130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:13.921416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] PATH_INFO: `/v3/projects/a27fb4683b834ed48ea1fab751f0339d/users/d689537b02e34a618c94f55bdbc454fa/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:13.937227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27fb4683b834ed48ea1fab751f0339d, user_id=d689537b02e34a618c94f55bdbc454fa, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:13.939931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:14.009694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1204/2386] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:13 2022] PUT /identity/v3/projects/a27fb4683b834ed48ea1fab751f0339d/users/d689537b02e34a618c94f55bdbc454fa/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:14.014006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:14.024263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8162d5-0153-448a-a0ef-35edc4531a3f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:14.082271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d043d9-6a38-4673-86e2-3b143766b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:14.082924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d043d9-6a38-4673-86e2-3b143766b766 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:14.083201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d043d9-6a38-4673-86e2-3b143766b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:14.083509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d043d9-6a38-4673-86e2-3b143766b766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:14.084150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d043d9-6a38-4673-86e2-3b143766b766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:14.085756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d043d9-6a38-4673-86e2-3b143766b766 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:14.096766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1183/2387] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:14.100915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:14.112448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df182-f33e-4144-8d19-718b4f1064ef admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:14.117000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:14.117686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:14.118014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:14.118299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] PATH_INFO: `/v3/projects/a27fb4683b834ed48ea1fab751f0339d/users/d689537b02e34a618c94f55bdbc454fa/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:14.120193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27fb4683b834ed48ea1fab751f0339d, user_id=d689537b02e34a618c94f55bdbc454fa, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:14.123687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:14.134063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1205/2388] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:14 2022] PUT /identity/v3/projects/a27fb4683b834ed48ea1fab751f0339d/users/d689537b02e34a618c94f55bdbc454fa/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:14.145703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150503-23ad-400c-9bd9-782a3fac11d3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:14.146021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150503-23ad-400c-9bd9-782a3fac11d3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:14.146226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150503-23ad-400c-9bd9-782a3fac11d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:14.174263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-53150503-23ad-400c-9bd9-782a3fac11d3 None None] MFA Rules not processed for user `d689537b02e34a618c94f55bdbc454fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:14.175379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-53150503-23ad-400c-9bd9-782a3fac11d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:14.249279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1184/2389] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:14.261363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:14.263640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:14.323317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace06f36-0c95-4247-82c4-b9ce3ca2c512 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:14.327050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8401a6-476a-45a4-9e3d-91d52f15190b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:14.327692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8401a6-476a-45a4-9e3d-91d52f15190b service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:14.327970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8401a6-476a-45a4-9e3d-91d52f15190b service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:14.328264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8401a6-476a-45a4-9e3d-91d52f15190b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:14.337504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8401a6-476a-45a4-9e3d-91d52f15190b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:14.339176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8401a6-476a-45a4-9e3d-91d52f15190b service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:14.349345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1206/2390] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:15.330563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150503-23ad-400c-9bd9-782a3fac11d3 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:15.398517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150503-23ad-400c-9bd9-782a3fac11d3 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:15.403096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:15.403755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:15.404036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:15.404995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] PATH_INFO: `/v3/users/1627f2a48472401f958619197062813e` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:15.406142 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1627f2a48472401f958619197062813e)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:15.408130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:15.427720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:15.652589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1627f2a48472401f958619197062813e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:15.653504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1627f2a48472401f958619197062813e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:15.674628 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1627f2a48472401f958619197062813e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:15.758271 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1627f2a48472401f958619197062813e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:15.764695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1627f2a48472401f958619197062813e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:15.794866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1185/2391] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:15 2022] DELETE /identity/v3/users/1627f2a48472401f958619197062813e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:15.801413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b14848-783d-4921-9872-d030a75ba558 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:15.801995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b14848-783d-4921-9872-d030a75ba558 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:15.801995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b14848-783d-4921-9872-d030a75ba558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:15.827788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-40b14848-783d-4921-9872-d030a75ba558 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:15.829288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-40b14848-783d-4921-9872-d030a75ba558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:15.930759 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1207/2392] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:15.940544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:15.942956 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:16.018827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f08611-ddb9-48de-98cc-7587a53c60ac admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:16.025028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:16.025931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:16.026321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:16.026702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:16.039451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:16.042259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:16.059820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1186/2393] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:16.572292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b14848-783d-4921-9872-d030a75ba558 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:16.578916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-40b14848-783d-4921-9872-d030a75ba558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:16.587294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b14848-783d-4921-9872-d030a75ba558 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:16.592945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:16.593743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:16.594127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:16.594628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] PATH_INFO: `/v3/projects/687d6bb7373b44d1aee0f7b2e83377d5` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:16.595988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687d6bb7373b44d1aee0f7b2e83377d5)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:16.599785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:16.723689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:16.730852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687d6bb7373b44d1aee0f7b2e83377d5', 'request_id': 'req-aa87fbc9-4f6c-4759-ac14-efcf29441382'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:16.737807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687d6bb7373b44d1aee0f7b2e83377d5', 'request_id': 'req-aa87fbc9-4f6c-4759-ac14-efcf29441382'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:16.817738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687d6bb7373b44d1aee0f7b2e83377d5', 'request_id': 'req-aa87fbc9-4f6c-4759-ac14-efcf29441382'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:16.830163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] The token cache is being invalidate because project 687d6bb7373b44d1aee0f7b2e83377d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:16.830669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:16.831333 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:16.832850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1208/2394] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:16 2022] DELETE /identity/v3/projects/687d6bb7373b44d1aee0f7b2e83377d5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:16.837219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:16.847577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd704789-20ff-473f-beea-16d9c8749f83 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:16.914047 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:16.914460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:16.914659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:16.914947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] PATH_INFO: `/v3/users/d689537b02e34a618c94f55bdbc454fa` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:16.921636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d689537b02e34a618c94f55bdbc454fa)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:16.921636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:17.179695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:17.190662 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd689537b02e34a618c94f55bdbc454fa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:17.191801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd689537b02e34a618c94f55bdbc454fa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:17.205290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd689537b02e34a618c94f55bdbc454fa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:17.279642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd689537b02e34a618c94f55bdbc454fa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:17.280661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd689537b02e34a618c94f55bdbc454fa'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:17.294450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1187/2395] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:16 2022] DELETE /identity/v3/users/d689537b02e34a618c94f55bdbc454fa => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:17.743080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:17.744774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:17.762315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87fbc9-4f6c-4759-ac14-efcf29441382 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:17.823492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:17.824230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:17.824544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:17.824820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] PATH_INFO: `/v3/projects/a27fb4683b834ed48ea1fab751f0339d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:17.826534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27fb4683b834ed48ea1fab751f0339d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:17.828903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:17.948708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:17.950286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:17.959016 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27fb4683b834ed48ea1fab751f0339d', 'request_id': 'req-09a84c57-1208-47a3-8da6-412851678792'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:17.968879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27fb4683b834ed48ea1fab751f0339d', 'request_id': 'req-09a84c57-1208-47a3-8da6-412851678792'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:18.031968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca14e98-a33e-4fe8-bb8f-28a80f68e572 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:18.055959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27fb4683b834ed48ea1fab751f0339d', 'request_id': 'req-09a84c57-1208-47a3-8da6-412851678792'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:18.070142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] The token cache is being invalidate because project a27fb4683b834ed48ea1fab751f0339d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:18.070397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:18.071337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-09a84c57-1208-47a3-8da6-412851678792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:18.073130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1209/2396] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:17 2022] DELETE /identity/v3/projects/a27fb4683b834ed48ea1fab751f0339d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:18.079848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a349c-5cd3-4af8-8338-0267d5dd59a6 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.080720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a349c-5cd3-4af8-8338-0267d5dd59a6 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.081004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a349c-5cd3-4af8-8338-0267d5dd59a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.102871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-dd5a349c-5cd3-4af8-8338-0267d5dd59a6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:18.104117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-dd5a349c-5cd3-4af8-8338-0267d5dd59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:18.109141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ac658-5054-4a12-a1c3-3ae9e7b898e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:18.109961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac658-5054-4a12-a1c3-3ae9e7b898e3 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.110433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac658-5054-4a12-a1c3-3ae9e7b898e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.110895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac658-5054-4a12-a1c3-3ae9e7b898e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.114929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3a3ac658-5054-4a12-a1c3-3ae9e7b898e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:18.129436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ac658-5054-4a12-a1c3-3ae9e7b898e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:18.131049 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ac658-5054-4a12-a1c3-3ae9e7b898e3 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:18.144780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1188/2397] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:18.160336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:18.171521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1210/2398] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:18.179720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71fa3d-e2e1-47a5-841e-19529768dabb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.179964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71fa3d-e2e1-47a5-841e-19529768dabb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.180243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71fa3d-e2e1-47a5-841e-19529768dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.202929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-fa71fa3d-e2e1-47a5-841e-19529768dabb None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:18.207789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fa71fa3d-e2e1-47a5-841e-19529768dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:18.212530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1189/2399] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:18.217872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a349c-5cd3-4af8-8338-0267d5dd59a6 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:18.228242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a349c-5cd3-4af8-8338-0267d5dd59a6 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:18.234699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:18.235398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.235781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.236128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.236861 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:18.237275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:18.239071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:18.260946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71fa3d-e2e1-47a5-841e-19529768dabb None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:18.263651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1211/2400] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:18.271907 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71fa3d-e2e1-47a5-841e-19529768dabb None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:18.279993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:18.280589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.280868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.281141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.281970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:18.284173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:18.379454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1190/2401] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:18 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:18.382469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:18.394848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe433-404b-4cdc-a86d-e2c64336a50f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:18.461463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:18.462326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.462706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.463078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.464106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:18.466111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:18.566142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1212/2402] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:18 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:18.570262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:18.583484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ba995-f62b-499d-af1f-4997b377b716 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:18.589215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:18.590072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.590530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.590863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.591949 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:18.593594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:18.595964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:18.610346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1191/2403] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:55:18.611864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:18.622751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4fe1-6fe0-4976-8fdd-be8676178995 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:18.629321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59de992-7f8e-42d9-bd0b-6a1d56287d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:18.630027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59de992-7f8e-42d9-bd0b-6a1d56287d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.630292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59de992-7f8e-42d9-bd0b-6a1d56287d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.630687 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59de992-7f8e-42d9-bd0b-6a1d56287d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.631382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59de992-7f8e-42d9-bd0b-6a1d56287d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:18.633003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59de992-7f8e-42d9-bd0b-6a1d56287d92 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:18.651822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1213/2404] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:18.656305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:18.677198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b527267-ea79-4ff6-94d5-bdd6717a1876 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:18.681808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:18.682623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.682908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.683184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] PATH_INFO: `/v3/projects/b1a1ab9463de4a98b1d7e683aa631dd0/users/0f9915bc50a14c77b3e2903a7d6caf26/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.728430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1ab9463de4a98b1d7e683aa631dd0, user_id=0f9915bc50a14c77b3e2903a7d6caf26, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:18.731150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:18.812412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1192/2405] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:18 2022] PUT /identity/v3/projects/b1a1ab9463de4a98b1d7e683aa631dd0/users/0f9915bc50a14c77b3e2903a7d6caf26/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:18.823463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c396-8623-4108-8fb9-061f1defc236 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:18.823644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c396-8623-4108-8fb9-061f1defc236 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:18.824200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904c396-8623-4108-8fb9-061f1defc236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:18.853916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b904c396-8623-4108-8fb9-061f1defc236 None None] MFA Rules not processed for user `0f9915bc50a14c77b3e2903a7d6caf26`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:18.855142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b904c396-8623-4108-8fb9-061f1defc236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:18.939579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1214/2406] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:18.944392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:19.034996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504cef-9933-4c9c-9e46-eb1f78d4aadd admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:19.044299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:19.045604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.045890 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.046328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.046983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:19.049214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:19.155281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1193/2407] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:18 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:19.159398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904c396-8623-4108-8fb9-061f1defc236 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:19.171671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904c396-8623-4108-8fb9-061f1defc236 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:19.235672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:19.246597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:19.246816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.247354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.255446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.255446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:19.255446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:19.339243 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1215/2408] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:19 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:19.340496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:19.352106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ab847-4285-4e29-8c3f-46abee89562a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:19.357088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:19.357627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.358087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.358370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.359019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:19.360735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:19.371923 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1194/2409] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:19.376336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:19.387332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55c2bb-011b-4b4f-aedf-17474d071abf admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:19.392748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:19.393402 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.393718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.393993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] PATH_INFO: `/v3/projects/d2d6355dc4e642d996b5fb63fda5bb7d/users/6cb082e9418d454aac224f04d8504b34/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.412006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d6355dc4e642d996b5fb63fda5bb7d, user_id=6cb082e9418d454aac224f04d8504b34, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:19.413785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:19.548139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1216/2410] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:19 2022] PUT /identity/v3/projects/d2d6355dc4e642d996b5fb63fda5bb7d/users/6cb082e9418d454aac224f04d8504b34/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:19.562957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:19.573997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec78a9-3f6b-4e46-a133-5e1927e34d84 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:19.638035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764711-688c-4b04-b25e-561cded81c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:19.639486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764711-688c-4b04-b25e-561cded81c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.639760 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764711-688c-4b04-b25e-561cded81c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.640034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764711-688c-4b04-b25e-561cded81c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.640712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64764711-688c-4b04-b25e-561cded81c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:19.642412 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64764711-688c-4b04-b25e-561cded81c8f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:19.652607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1195/2411] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:19.657134 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:19.668183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969666-7c54-4393-b302-8bd4ac4e66e1 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:19.673179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:19.680523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.680813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.681238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] PATH_INFO: `/v3/projects/d2d6355dc4e642d996b5fb63fda5bb7d/users/6cb082e9418d454aac224f04d8504b34/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.683545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d6355dc4e642d996b5fb63fda5bb7d, user_id=6cb082e9418d454aac224f04d8504b34, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:19.687974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:19.700820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1217/2412] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:19 2022] PUT /identity/v3/projects/d2d6355dc4e642d996b5fb63fda5bb7d/users/6cb082e9418d454aac224f04d8504b34/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:19.713936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d490fb-5d03-4bab-8be3-d3df08b73083 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.714236 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d490fb-5d03-4bab-8be3-d3df08b73083 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.714541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d490fb-5d03-4bab-8be3-d3df08b73083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.746303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-87d490fb-5d03-4bab-8be3-d3df08b73083 None None] MFA Rules not processed for user `6cb082e9418d454aac224f04d8504b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:19.747565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-87d490fb-5d03-4bab-8be3-d3df08b73083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:19.786563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:19.836448 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1196/2413] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:19.850038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:19.851796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:19.931356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddcc79-d4ce-4e04-bf05-48aa25764704 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:19.935049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f57b9b-ab3b-40db-80fb-c4af80376214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:19.936806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f57b9b-ab3b-40db-80fb-c4af80376214 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:19.937236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f57b9b-ab3b-40db-80fb-c4af80376214 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:19.937236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f57b9b-ab3b-40db-80fb-c4af80376214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:19.948738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f57b9b-ab3b-40db-80fb-c4af80376214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:19.951255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f57b9b-ab3b-40db-80fb-c4af80376214 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:19.962835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1218/2414] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:20.037743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d490fb-5d03-4bab-8be3-d3df08b73083 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:20.115414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d490fb-5d03-4bab-8be3-d3df08b73083 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:20.119941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:20.120581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:20.120863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:20.121324 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] PATH_INFO: `/v3/users/0f9915bc50a14c77b3e2903a7d6caf26` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:20.123629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9915bc50a14c77b3e2903a7d6caf26)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:20.125560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:20.327264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9915bc50a14c77b3e2903a7d6caf26'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:20.327985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9915bc50a14c77b3e2903a7d6caf26'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:20.341207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9915bc50a14c77b3e2903a7d6caf26'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:20.392532 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9915bc50a14c77b3e2903a7d6caf26'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:20.393151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9915bc50a14c77b3e2903a7d6caf26'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:20.408659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1197/2415] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:20 2022] DELETE /identity/v3/users/0f9915bc50a14c77b3e2903a7d6caf26 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:20.413704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:20.413986 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:20.414300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:20.440683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:20.446222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:20.511073 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1219/2416] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:20.521032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:20.522439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:20.573936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:20.580417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe1d47-d60d-41d6-9b96-02d08fa4f5b5 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:20.593563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:20.594533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:20.595409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:20.595937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:20.606814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:20.609234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:20.619820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1198/2417] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:21.002911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:21.002911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:21.014625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c58dd-7027-4907-89cb-a43e81e8b511 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:21.019247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:21.020042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:21.020408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:21.020682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] PATH_INFO: `/v3/projects/b1a1ab9463de4a98b1d7e683aa631dd0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:21.021808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a1ab9463de4a98b1d7e683aa631dd0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:21.023720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:21.167158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:21.170220 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a1ab9463de4a98b1d7e683aa631dd0', 'request_id': 'req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.176268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a1ab9463de4a98b1d7e683aa631dd0', 'request_id': 'req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.290238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a1ab9463de4a98b1d7e683aa631dd0', 'request_id': 'req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.301226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] The token cache is being invalidate because project b1a1ab9463de4a98b1d7e683aa631dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:21.301517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.302142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.303638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1220/2418] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:20 2022] DELETE /identity/v3/projects/b1a1ab9463de4a98b1d7e683aa631dd0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:21.307651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:21.318475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9942c9-c26f-4f1b-82c4-620170da9afd service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:21.374479 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:21.375105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:21.375386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:21.375697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] PATH_INFO: `/v3/users/6cb082e9418d454aac224f04d8504b34` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:21.376812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb082e9418d454aac224f04d8504b34)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:21.378715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:21.588925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb082e9418d454aac224f04d8504b34'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.589501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb082e9418d454aac224f04d8504b34'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.601259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb082e9418d454aac224f04d8504b34'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.661181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb082e9418d454aac224f04d8504b34'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.661802 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0a96a557-f428-4ce1-9acc-f25cb73108aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb082e9418d454aac224f04d8504b34'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:21.675556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1199/2419] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:21 2022] DELETE /identity/v3/users/6cb082e9418d454aac224f04d8504b34 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:22.114720 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:22.116180 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:22.128921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78332b2-0adb-4e7f-87ae-34a20a1b1fff admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:22.198568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:22.199365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.199683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.199963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] PATH_INFO: `/v3/projects/d2d6355dc4e642d996b5fb63fda5bb7d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.202351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d6355dc4e642d996b5fb63fda5bb7d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:22.204396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:22.302119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d6355dc4e642d996b5fb63fda5bb7d', 'request_id': 'req-c5780fa6-ff31-4b90-8052-b682cad42f12'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:22.308528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d6355dc4e642d996b5fb63fda5bb7d', 'request_id': 'req-c5780fa6-ff31-4b90-8052-b682cad42f12'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:22.398319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d6355dc4e642d996b5fb63fda5bb7d', 'request_id': 'req-c5780fa6-ff31-4b90-8052-b682cad42f12'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:22.410190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] The token cache is being invalidate because project d2d6355dc4e642d996b5fb63fda5bb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:22.410482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:22.411114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c5780fa6-ff31-4b90-8052-b682cad42f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:22.412594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1221/2420] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:22 2022] DELETE /identity/v3/projects/d2d6355dc4e642d996b5fb63fda5bb7d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:22.418721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa706-84a8-4015-9634-12f9a03bb310 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.419300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa706-84a8-4015-9634-12f9a03bb310 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.419300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa706-84a8-4015-9634-12f9a03bb310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.438980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b13fa706-84a8-4015-9634-12f9a03bb310 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:22.442022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b13fa706-84a8-4015-9634-12f9a03bb310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:22.500796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1200/2421] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:22.508611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d256fb-e921-406e-9fe7-e7e6ba2fa250 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.508989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d256fb-e921-406e-9fe7-e7e6ba2fa250 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.509294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d256fb-e921-406e-9fe7-e7e6ba2fa250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.531672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-03d256fb-e921-406e-9fe7-e7e6ba2fa250 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:22.533014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-03d256fb-e921-406e-9fe7-e7e6ba2fa250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:22.541062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1222/2422] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:22.545749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fa706-84a8-4015-9634-12f9a03bb310 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:22.555356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fa706-84a8-4015-9634-12f9a03bb310 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:22.560901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:22.561522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.561804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.562109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.562753 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:22.563054 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:22.564686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:22.567136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:22.577554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1201/2423] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:22.581951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d256fb-e921-406e-9fe7-e7e6ba2fa250 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:22.594676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d256fb-e921-406e-9fe7-e7e6ba2fa250 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:22.599542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:22.600146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.600427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.600706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.601335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:22.603376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:22.720374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1223/2424] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:22 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:22.724511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:22.734642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6ff52-8c7a-4f9e-ada3-1ff93f0a1f02 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:22.792139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:22.792777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.793066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.793339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.793988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:22.795954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:22.878962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1202/2425] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:22 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:22.883117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:22.894003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92462901-d163-4857-8b24-f67a8aa7e682 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:22.899352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:22.900095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.900377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.900628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.901294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:22.902899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:22.913416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1224/2426] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:22.917331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:22.928480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc942-404a-4aef-bfcd-9534d6032d7b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:22.933055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d16c-d213-491d-8fe6-f20477bb77b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:22.933649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d16c-d213-491d-8fe6-f20477bb77b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.933929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d16c-d213-491d-8fe6-f20477bb77b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.934376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d16c-d213-491d-8fe6-f20477bb77b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.935044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d16c-d213-491d-8fe6-f20477bb77b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:22.937226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555d16c-d213-491d-8fe6-f20477bb77b3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:22.947039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1203/2427] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:22.951233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:22.961068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fed7e-7667-46c2-a796-8bc3be79bbab admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:22.966019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:22.966854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:22.967132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:22.967408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] PATH_INFO: `/v3/projects/050d6bd846824aeba0b6eeda9a4eeaaa/users/8cf7c8343c2844cbb35b122d6c19d481/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:22.983267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050d6bd846824aeba0b6eeda9a4eeaaa, user_id=8cf7c8343c2844cbb35b122d6c19d481, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:22.985884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.063734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:23.068356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1225/2428] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:22 2022] PUT /identity/v3/projects/050d6bd846824aeba0b6eeda9a4eeaaa/users/8cf7c8343c2844cbb35b122d6c19d481/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:23.080521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.080805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.081201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.110320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] MFA Rules not processed for user `8cf7c8343c2844cbb35b122d6c19d481`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:23.112457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:23.176649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1204/2429] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:23.181213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.244940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104ec7-8078-4396-96df-bdc7a541b675 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.249658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.250264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.250529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.250799 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.251459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:23.253350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.316667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.318225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:23.320636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1226/2430] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:23 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:23.328240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.377162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993b62a-5d75-4c99-8a6c-ea98996123a8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.390701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d59a6-2ead-4e76-a976-f380522a239c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.395486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.396127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.396596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.396762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.397179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:23.397396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:23.399351 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.429694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.430280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.430556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.430862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.432658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:23.444936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:23.446332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.457246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1205/2431] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:23.518171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1227/2432] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:23 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:23.522090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.531887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113fabf-f54d-4f0b-9c0b-68de89eb3790 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.536506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.537105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.537403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.537678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.538316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:23.539948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.551242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1206/2433] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:23.555562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.566656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e314b21-81c0-4a6f-85b5-402b82648573 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.571567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.572219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.572494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.572762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] PATH_INFO: `/v3/projects/da833946497e4405b3c2bc7242a019b2/users/9bf0910aa05f4679bb7d5bcfa266d8e2/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.588477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da833946497e4405b3c2bc7242a019b2, user_id=9bf0910aa05f4679bb7d5bcfa266d8e2, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:23.591476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.678463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1228/2434] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:23 2022] PUT /identity/v3/projects/da833946497e4405b3c2bc7242a019b2/users/9bf0910aa05f4679bb7d5bcfa266d8e2/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:23.682527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.693758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c6ade-741f-4a36-93f3-30a4fded82b8 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.752061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c92ce-041f-4e5f-a3ba-ec8fd6bd5205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.752668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c92ce-041f-4e5f-a3ba-ec8fd6bd5205 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.752948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c92ce-041f-4e5f-a3ba-ec8fd6bd5205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.753216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c92ce-041f-4e5f-a3ba-ec8fd6bd5205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.753848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c92ce-041f-4e5f-a3ba-ec8fd6bd5205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:23.755462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c92ce-041f-4e5f-a3ba-ec8fd6bd5205 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.766053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1207/2435] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:23.770242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.781416 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d33a4-4e52-4c00-958f-24499cf51b7e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.786131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.786780 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.787057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.787329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] PATH_INFO: `/v3/projects/da833946497e4405b3c2bc7242a019b2/users/9bf0910aa05f4679bb7d5bcfa266d8e2/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.789262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da833946497e4405b3c2bc7242a019b2, user_id=9bf0910aa05f4679bb7d5bcfa266d8e2, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:23.791935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:23.803128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1229/2436] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:23 2022] PUT /identity/v3/projects/da833946497e4405b3c2bc7242a019b2/users/9bf0910aa05f4679bb7d5bcfa266d8e2/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:23.813420 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca06831-cb0e-45b3-aacf-75cfe49125cb None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.813708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca06831-cb0e-45b3-aacf-75cfe49125cb None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.813977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca06831-cb0e-45b3-aacf-75cfe49125cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:23.843720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1ca06831-cb0e-45b3-aacf-75cfe49125cb None None] MFA Rules not processed for user `9bf0910aa05f4679bb7d5bcfa266d8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:23.844929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1ca06831-cb0e-45b3-aacf-75cfe49125cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:23.918730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1208/2437] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:23.930754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:23.932485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:23.977129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:23.992672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0252b-d5c1-44b8-aa47-801ab9c5068f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:23.996393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4704bc-9655-4057-b774-deb64cab8869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:23.997042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4704bc-9655-4057-b774-deb64cab8869 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:23.997321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4704bc-9655-4057-b774-deb64cab8869 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:23.997970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4704bc-9655-4057-b774-deb64cab8869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:24.007306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4704bc-9655-4057-b774-deb64cab8869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:24.008707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4704bc-9655-4057-b774-deb64cab8869 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:24.020061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1230/2438] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:25.139916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca06831-cb0e-45b3-aacf-75cfe49125cb None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:25.177348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:25.206510 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca06831-cb0e-45b3-aacf-75cfe49125cb None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:25.211160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:25.211884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:25.212167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:25.212439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] PATH_INFO: `/v3/users/8cf7c8343c2844cbb35b122d6c19d481` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:25.213804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf7c8343c2844cbb35b122d6c19d481)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:25.217000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:25.411822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf7c8343c2844cbb35b122d6c19d481'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:25.412569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf7c8343c2844cbb35b122d6c19d481'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:25.425524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf7c8343c2844cbb35b122d6c19d481'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:25.512484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf7c8343c2844cbb35b122d6c19d481'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:25.513107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf7c8343c2844cbb35b122d6c19d481'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:25.526369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1209/2439] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:25 2022] DELETE /identity/v3/users/8cf7c8343c2844cbb35b122d6c19d481 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:25.531611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:25.532099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:25.532199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:25.551412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:25.552625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:25.612684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1231/2440] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:25.622721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:25.624714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:25.682497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8b6b-dce8-4144-b3ac-b74cfe584609 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:25.687133 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:25.687792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:25.688079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:25.688356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:25.702595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:25.704094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:25.716016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1210/2441] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:26.206652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:26.208164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:26.240469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec364-1779-4e68-a8c6-3952eb16dfe9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:26.245149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:26.245812 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:26.246093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:26.246369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] PATH_INFO: `/v3/projects/050d6bd846824aeba0b6eeda9a4eeaaa` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:26.247625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=050d6bd846824aeba0b6eeda9a4eeaaa)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:26.250038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:26.392532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050d6bd846824aeba0b6eeda9a4eeaaa', 'request_id': 'req-a224a3da-5819-45ba-b8f4-03dec0101b65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.403307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050d6bd846824aeba0b6eeda9a4eeaaa', 'request_id': 'req-a224a3da-5819-45ba-b8f4-03dec0101b65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.503440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050d6bd846824aeba0b6eeda9a4eeaaa', 'request_id': 'req-a224a3da-5819-45ba-b8f4-03dec0101b65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.513481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] The token cache is being invalidate because project 050d6bd846824aeba0b6eeda9a4eeaaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:26.513784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.514505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.516035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1232/2442] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:26 2022] DELETE /identity/v3/projects/050d6bd846824aeba0b6eeda9a4eeaaa => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:26.521009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:26.535915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ca18-df24-4d5b-9877-45c0a0928a01 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:26.595879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:26.604067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:26.604704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:26.604984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:26.605259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] PATH_INFO: `/v3/users/9bf0910aa05f4679bb7d5bcfa266d8e2` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:26.606420 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf0910aa05f4679bb7d5bcfa266d8e2)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:26.608455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:26.858572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf0910aa05f4679bb7d5bcfa266d8e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.858572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf0910aa05f4679bb7d5bcfa266d8e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.870248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf0910aa05f4679bb7d5bcfa266d8e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.929893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf0910aa05f4679bb7d5bcfa266d8e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.930533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf0910aa05f4679bb7d5bcfa266d8e2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:26.943706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1211/2443] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:26 2022] DELETE /identity/v3/users/9bf0910aa05f4679bb7d5bcfa266d8e2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:27.005498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:27.006970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:27.020949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224a3da-5819-45ba-b8f4-03dec0101b65 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:27.080417 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:27.081038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.081316 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.081586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] PATH_INFO: `/v3/users/ef12fbaea8c14f548429b3733840ceeb` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.082706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef12fbaea8c14f548429b3733840ceeb)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:27.084633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:27.089368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:27.281241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef12fbaea8c14f548429b3733840ceeb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.281990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef12fbaea8c14f548429b3733840ceeb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.294112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef12fbaea8c14f548429b3733840ceeb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.353215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef12fbaea8c14f548429b3733840ceeb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.353871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef12fbaea8c14f548429b3733840ceeb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.360664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:27.363588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:27.376406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1233/2444] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:27 2022] DELETE /identity/v3/users/ef12fbaea8c14f548429b3733840ceeb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:27.393200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e665e0-e5d3-4533-b584-157955eeaa30 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:27.462344 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:27.462986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.463266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.463831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] PATH_INFO: `/v3/projects/da833946497e4405b3c2bc7242a019b2` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.464967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da833946497e4405b3c2bc7242a019b2)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:27.467655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:27.570997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da833946497e4405b3c2bc7242a019b2', 'request_id': 'req-ea153b8e-0a01-404f-8e5d-40f20fa27703'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.577797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da833946497e4405b3c2bc7242a019b2', 'request_id': 'req-ea153b8e-0a01-404f-8e5d-40f20fa27703'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.605726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:27.607766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:27.624222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6309f19-078f-40a4-b777-711ce6ca548b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:27.626797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da833946497e4405b3c2bc7242a019b2', 'request_id': 'req-ea153b8e-0a01-404f-8e5d-40f20fa27703'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.641472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] The token cache is being invalidate because project da833946497e4405b3c2bc7242a019b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:27.641767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.642457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ea153b8e-0a01-404f-8e5d-40f20fa27703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.643987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1212/2445] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:27 2022] DELETE /identity/v3/projects/da833946497e4405b3c2bc7242a019b2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:27.648630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d0fd-07ec-4e2d-97db-79600512c9d1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.648916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d0fd-07ec-4e2d-97db-79600512c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.649230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6d0fd-07ec-4e2d-97db-79600512c9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.657988 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:27.670128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-56e6d0fd-07ec-4e2d-97db-79600512c9d1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:27.671480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-56e6d0fd-07ec-4e2d-97db-79600512c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:27.692164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:27.692953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.693089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.693357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] PATH_INFO: `/v3/projects/4021c1633f434581b34a1357c8e63624` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.694872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4021c1633f434581b34a1357c8e63624)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:27.696500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:27.741537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1213/2446] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:27.749789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8ee87-241d-4b7a-b80a-50f555425546 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.750078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8ee87-241d-4b7a-b80a-50f555425546 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.750356 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8ee87-241d-4b7a-b80a-50f555425546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.771231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d0f8ee87-241d-4b7a-b80a-50f555425546 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:27.772492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d0f8ee87-241d-4b7a-b80a-50f555425546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:27.783398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4021c1633f434581b34a1357c8e63624', 'request_id': 'req-911bccb9-2cca-4107-b00b-eeecdf1d081e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.789819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4021c1633f434581b34a1357c8e63624', 'request_id': 'req-911bccb9-2cca-4107-b00b-eeecdf1d081e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.834464 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1214/2447] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:27.839328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8ee87-241d-4b7a-b80a-50f555425546 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:27.849064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8ee87-241d-4b7a-b80a-50f555425546 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:27.849840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4021c1633f434581b34a1357c8e63624', 'request_id': 'req-911bccb9-2cca-4107-b00b-eeecdf1d081e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.853823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:27.854468 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.854735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.854957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.855759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:27.855932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:27.858187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:27.864019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] The token cache is being invalidate because project 4021c1633f434581b34a1357c8e63624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:27.864374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.870670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-911bccb9-2cca-4107-b00b-eeecdf1d081e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:27.870670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1234/2448] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:27 2022] DELETE /identity/v3/projects/4021c1633f434581b34a1357c8e63624 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:27.871070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1215/2449] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:27.875022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:27.875348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01aed-2191-43f2-badc-d179e8ae5370 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.875727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01aed-2191-43f2-badc-d179e8ae5370 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.876009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa01aed-2191-43f2-badc-d179e8ae5370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.877102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:27.890489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea068cf-1676-422b-91e1-aae6bb5347eb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:27.897336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:27.897945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.898227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.902951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.902951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:27.903397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-bfa01aed-2191-43f2-badc-d179e8ae5370 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:27.903397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-bfa01aed-2191-43f2-badc-d179e8ae5370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:27.903667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:27.910447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1235/2450] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:27.918708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dcb9d-a1b1-4cce-b4ee-a8bf49525c63 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:27.919198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dcb9d-a1b1-4cce-b4ee-a8bf49525c63 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:27.920169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dcb9d-a1b1-4cce-b4ee-a8bf49525c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:27.936923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:27.942363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fc9dcb9d-a1b1-4cce-b4ee-a8bf49525c63 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:27.943591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fc9dcb9d-a1b1-4cce-b4ee-a8bf49525c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:28.048671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1236/2451] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:28.053625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dcb9d-a1b1-4cce-b4ee-a8bf49525c63 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.063582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dcb9d-a1b1-4cce-b4ee-a8bf49525c63 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.068654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.069289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.069565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.069834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.070527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:28.070827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.072477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.085424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1237/2452] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:28.090260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.100745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38310922-0ccd-45ff-85a6-62df39892791 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.105844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.106448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.106719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.107626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.108451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.110625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.497254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1216/2453] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:27 2022] POST /identity/v3/projects => generated 383 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:28.504052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.514593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1238/2454] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:28 2022] POST /identity/v3/projects => generated 379 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:28.518603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.568903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5976d-d85a-4808-bfdc-c17d090f982f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.582825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:28.584472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea58f7-adc6-469f-8f77-771fcdaf1901 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.589353 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.589947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.590223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.590734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.591267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.594340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.626999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.627629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.632175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.632175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.632175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.632175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.666621 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1239/2455] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:28 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:28.670926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.680315 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6584c57-b9fd-4beb-a229-557c26236bbe admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.684929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.686037 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.686371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.686647 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.687269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.689027 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.699131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1240/2456] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:55:28.703955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.716756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1217/2457] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:28 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:28.718686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa94124-5367-4ce7-b6f5-4d709cb115fe admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.721004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.723493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.724086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.724420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.724700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.725326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.726903 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.731118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d55e4-688d-439b-b7d0-d86b7fcf6092 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.736200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.736796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.737078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.737353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.737563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1241/2458] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:55:28.737996 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.739609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.741716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.751106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1218/2459] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:55:28.752403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14056c7a-9a58-4436-80a1-8c0584fc8e8b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.754835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.756975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a0a52-5eb9-4060-bc2f-7353b417ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.757607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0a52-5eb9-4060-bc2f-7353b417ba92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.757975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0a52-5eb9-4060-bc2f-7353b417ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.758251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0a52-5eb9-4060-bc2f-7353b417ba92 admin admin] PATH_INFO: `/v3/projects/c632d123c7294504bc5c0a4df1cabf35/users/411f83cc0aec47b886c9a41438e4d8b5/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.765659 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6223f0-1cb2-4f00-89e2-201285e1383a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.770594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.771345 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.771650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.771927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.772579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.773882 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a0a52-5eb9-4060-bc2f-7353b417ba92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c632d123c7294504bc5c0a4df1cabf35, user_id=411f83cc0aec47b886c9a41438e4d8b5, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.774125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.776591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a0a52-5eb9-4060-bc2f-7353b417ba92 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.786266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1219/2460] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:55:28.792468 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.803654 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944291a-8d05-4fd7-9731-6988fdc2a41e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:28.808391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2d814-34c0-4c80-9078-3bb823c0906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:28.809029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d814-34c0-4c80-9078-3bb823c0906b admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.809312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d814-34c0-4c80-9078-3bb823c0906b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.809587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2d814-34c0-4c80-9078-3bb823c0906b admin admin] PATH_INFO: `/v3/projects/64030b39e6fe495186bd7913fdd8b880/users/a2b05f7835754f5f9d5c39ccd9210060/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.824576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2d814-34c0-4c80-9078-3bb823c0906b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64030b39e6fe495186bd7913fdd8b880, user_id=a2b05f7835754f5f9d5c39ccd9210060, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:28.828043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2d814-34c0-4c80-9078-3bb823c0906b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:28.866893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1242/2461] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:28 2022] PUT /identity/v3/projects/c632d123c7294504bc5c0a4df1cabf35/users/411f83cc0aec47b886c9a41438e4d8b5/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:28.878666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf580034-acbe-4edd-a554-d5e260eea745 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.878954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf580034-acbe-4edd-a554-d5e260eea745 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.879260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf580034-acbe-4edd-a554-d5e260eea745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.907910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-cf580034-acbe-4edd-a554-d5e260eea745 None None] MFA Rules not processed for user `411f83cc0aec47b886c9a41438e4d8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:28.909123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cf580034-acbe-4edd-a554-d5e260eea745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:28.941820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1220/2462] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:28 2022] PUT /identity/v3/projects/64030b39e6fe495186bd7913fdd8b880/users/a2b05f7835754f5f9d5c39ccd9210060/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:28.953217 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:28.953583 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:28.953918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:28.971389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:28.976705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1243/2463] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:28.981484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf580034-acbe-4edd-a554-d5e260eea745 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:28.984114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] MFA Rules not processed for user `a2b05f7835754f5f9d5c39ccd9210060`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:28.985428 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:29.045853 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf580034-acbe-4edd-a554-d5e260eea745 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.050129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1221/2464] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:29.061596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:29.062951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:29.107739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.108347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.108603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.108871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.109617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.111520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.119649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e653c0-f717-4803-9801-de0a97dda09b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.123902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.124507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.124791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.125067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.130341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:29.134034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.135476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.144652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1222/2465] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:29.199996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1244/2466] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:28 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:29.204743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:29.215847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6a837-c8b5-44c1-917f-d53e7c19ded1 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.274158 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.274772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.275050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.275326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.275997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.277951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.410409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1223/2467] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:29 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:29.415021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:29.425722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cb836-4c15-46bc-82ce-886946c158eb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.430188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.430776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.431053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.431322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.431990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.433571 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.444008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1245/2468] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:29.448455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:29.460138 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e13af-cbe9-4b05-9bc6-e1f4782808bf admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.465156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.468213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.468213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.468213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] PATH_INFO: `/v3/projects/7e708dfccc9144cfaea33279c7fb9b1b/users/67477031ff6b4d65a6bed655d2b2bcdb/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.485480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e708dfccc9144cfaea33279c7fb9b1b, user_id=67477031ff6b4d65a6bed655d2b2bcdb, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.485480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.564617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1224/2469] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:29 2022] PUT /identity/v3/projects/7e708dfccc9144cfaea33279c7fb9b1b/users/67477031ff6b4d65a6bed655d2b2bcdb/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:29.568784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:29.579252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d673f2-3c10-4177-88a7-7e82f69a3ebd admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.637044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3df2af-3a86-442a-b0b6-c337cf9050b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.637642 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df2af-3a86-442a-b0b6-c337cf9050b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.637917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df2af-3a86-442a-b0b6-c337cf9050b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.638887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3df2af-3a86-442a-b0b6-c337cf9050b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.639558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3df2af-3a86-442a-b0b6-c337cf9050b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.641136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3df2af-3a86-442a-b0b6-c337cf9050b9 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.650699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1246/2470] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:29.655223 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:29.665780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8f50-63d7-4ab5-b2c7-c88c2283158a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.670835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.671507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.671788 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.672057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] PATH_INFO: `/v3/projects/7e708dfccc9144cfaea33279c7fb9b1b/users/67477031ff6b4d65a6bed655d2b2bcdb/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.673948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e708dfccc9144cfaea33279c7fb9b1b, user_id=67477031ff6b4d65a6bed655d2b2bcdb, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.676607 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.688608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1225/2471] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:29 2022] PUT /identity/v3/projects/7e708dfccc9144cfaea33279c7fb9b1b/users/67477031ff6b4d65a6bed655d2b2bcdb/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:29.706342 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6947ce-7730-4a33-b9d9-a812bd13c7fb None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.706625 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6947ce-7730-4a33-b9d9-a812bd13c7fb None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.706901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6947ce-7730-4a33-b9d9-a812bd13c7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.734879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-3b6947ce-7730-4a33-b9d9-a812bd13c7fb None None] MFA Rules not processed for user `67477031ff6b4d65a6bed655d2b2bcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:29.736083 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3b6947ce-7730-4a33-b9d9-a812bd13c7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:29.739935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:29.808159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1247/2472] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:29.821097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:29.879864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c033fb9-b2d7-4663-9663-8b3dc7697302 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:29.883667 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:29.884477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:29.884612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:29.884813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:29.895205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:29.900157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:29.907190 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1226/2473] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:30.156476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6947ce-7730-4a33-b9d9-a812bd13c7fb None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:30.166633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6947ce-7730-4a33-b9d9-a812bd13c7fb None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:30.170282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7506fc-6544-4872-b6a9-23015a8fd8ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:30.170895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7506fc-6544-4872-b6a9-23015a8fd8ca service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:30.171172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7506fc-6544-4872-b6a9-23015a8fd8ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:30.171462 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7506fc-6544-4872-b6a9-23015a8fd8ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:30.228127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7506fc-6544-4872-b6a9-23015a8fd8ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:30.229542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7506fc-6544-4872-b6a9-23015a8fd8ca service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:30.238653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1248/2474] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:36.249043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:36.293309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:36.307591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9f8cd-a266-4a9c-bbcf-a8cdc372814c service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:36.312296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:36.312941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:36.313220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:36.313493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] PATH_INFO: `/v3/users/a2b05f7835754f5f9d5c39ccd9210060` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:36.314609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b05f7835754f5f9d5c39ccd9210060)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:36.316676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:36.508626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b05f7835754f5f9d5c39ccd9210060'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:36.509280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b05f7835754f5f9d5c39ccd9210060'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:36.522185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b05f7835754f5f9d5c39ccd9210060'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:36.597756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b05f7835754f5f9d5c39ccd9210060'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:36.598382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b05f7835754f5f9d5c39ccd9210060'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:36.612112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1227/2475] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:36 2022] DELETE /identity/v3/users/a2b05f7835754f5f9d5c39ccd9210060 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:36.616899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:36.617400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:36.617517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:36.637040 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:36.638213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:36.698637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1249/2476] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:36.709180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:36.710591 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:36.766743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955003cb-f101-47c3-9c05-b36e0bff7ca3 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:36.770298 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50520787-74bb-4e34-a5d4-69dca80761f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:36.770898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50520787-74bb-4e34-a5d4-69dca80761f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:36.771179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50520787-74bb-4e34-a5d4-69dca80761f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:36.771476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50520787-74bb-4e34-a5d4-69dca80761f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:36.780992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50520787-74bb-4e34-a5d4-69dca80761f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:36.782401 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50520787-74bb-4e34-a5d4-69dca80761f8 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:36.791682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1228/2477] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:37.252223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:37.253765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:37.266666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f62e01-3336-4b14-b979-9a1097db3c85 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:37.272048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:37.272688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:37.273117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:37.273386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] PATH_INFO: `/v3/projects/64030b39e6fe495186bd7913fdd8b880` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:37.274576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64030b39e6fe495186bd7913fdd8b880)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:37.276669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:37.367249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:37.377980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64030b39e6fe495186bd7913fdd8b880', 'request_id': 'req-315906fe-f21e-4bc8-8fef-af92a1547ea2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:37.384645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64030b39e6fe495186bd7913fdd8b880', 'request_id': 'req-315906fe-f21e-4bc8-8fef-af92a1547ea2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:37.437848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64030b39e6fe495186bd7913fdd8b880', 'request_id': 'req-315906fe-f21e-4bc8-8fef-af92a1547ea2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:37.448654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] The token cache is being invalidate because project 64030b39e6fe495186bd7913fdd8b880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:37.448944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:37.449562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-315906fe-f21e-4bc8-8fef-af92a1547ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:37.451129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1250/2478] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:37 2022] DELETE /identity/v3/projects/64030b39e6fe495186bd7913fdd8b880 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:37.456689 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a5437-79de-4973-a73f-2a5f55229716 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:37.457257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a5437-79de-4973-a73f-2a5f55229716 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:37.457367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a5437-79de-4973-a73f-2a5f55229716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:37.477022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-be6a5437-79de-4973-a73f-2a5f55229716 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:37.478208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-be6a5437-79de-4973-a73f-2a5f55229716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:37.538526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1229/2479] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:37.547548 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a23b-5ed7-4e36-b961-891bcf329c24 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:37.547942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a23b-5ed7-4e36-b961-891bcf329c24 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:37.548222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729a23b-5ed7-4e36-b961-891bcf329c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:37.569362 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9729a23b-5ed7-4e36-b961-891bcf329c24 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:37.570550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9729a23b-5ed7-4e36-b961-891bcf329c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:37.581080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1251/2480] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:37.582927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a5437-79de-4973-a73f-2a5f55229716 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:37.593852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a5437-79de-4973-a73f-2a5f55229716 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:37.598520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:37.599195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:37.599596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:37.599880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:37.600535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:37.600919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:37.602572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:37.610377 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:37.618200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1230/2481] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:37.625856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a23b-5ed7-4e36-b961-891bcf329c24 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:37.639742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729a23b-5ed7-4e36-b961-891bcf329c24 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:37.646802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:37.647767 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:37.648246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:37.648684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:37.649738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:37.652909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:37.801966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1252/2482] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:37 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:37.806335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:37.816382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f1ac-dea6-469d-8a4f-8565b568411b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:37.872028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:37.872769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:37.873363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:37.874005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:37.874952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:37.876936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:37.976126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1231/2483] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:37 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:37.980235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:37.990432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c3fc6-5c20-4620-8155-5b42e22231a3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:37.995062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:37.995681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:37.995990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:37.996260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:37.996895 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:37.998596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:38.008382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1253/2484] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:38.012268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:38.022775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8c3f6-b5d2-46cc-976b-91c886569578 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:38.027743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf9ae-0095-4a9f-94a0-0eb8b31eb80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:38.030150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf9ae-0095-4a9f-94a0-0eb8b31eb80e admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:38.030150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf9ae-0095-4a9f-94a0-0eb8b31eb80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:38.030150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf9ae-0095-4a9f-94a0-0eb8b31eb80e admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:38.030150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf9ae-0095-4a9f-94a0-0eb8b31eb80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:38.032137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf9ae-0095-4a9f-94a0-0eb8b31eb80e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:38.042882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1232/2485] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:38.047293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:38.057444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781377f-1b67-49ab-b037-700a4d921860 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:38.062159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:38.069834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:38.069834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:38.069834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] PATH_INFO: `/v3/projects/cf8d98d2065e4bef83b4f21a8b421110/users/134a05b72b5c403d88f2e0c2034532d6/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:38.079226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8d98d2065e4bef83b4f21a8b421110, user_id=134a05b72b5c403d88f2e0c2034532d6, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:38.081982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:38.204525 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1254/2486] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:38 2022] PUT /identity/v3/projects/cf8d98d2065e4bef83b4f21a8b421110/users/134a05b72b5c403d88f2e0c2034532d6/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:38.209651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:38.209944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:38.210248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:38.229674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:38.230866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:38.290118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1233/2487] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:38.302002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:38.303701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:38.365874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9f42e-20d9-4f38-8978-d72d8c2b78a7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:38.369546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c77452-ca6f-476e-83b3-1d972a886c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:38.370146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c77452-ca6f-476e-83b3-1d972a886c26 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:38.370424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c77452-ca6f-476e-83b3-1d972a886c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:38.370697 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c77452-ca6f-476e-83b3-1d972a886c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:38.380305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c77452-ca6f-476e-83b3-1d972a886c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:38.381820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c77452-ca6f-476e-83b3-1d972a886c26 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:38.391659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1255/2488] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:39.018821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:39.020336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:39.033066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc419-c9e7-4901-b335-bd528e7f277a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:39.037842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:39.038496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:39.040062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:39.040062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] PATH_INFO: `/v3/users/411f83cc0aec47b886c9a41438e4d8b5` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:39.040348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=411f83cc0aec47b886c9a41438e4d8b5)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:39.042236 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:39.223896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411f83cc0aec47b886c9a41438e4d8b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:39.224580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411f83cc0aec47b886c9a41438e4d8b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:39.238069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411f83cc0aec47b886c9a41438e4d8b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:39.340568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411f83cc0aec47b886c9a41438e4d8b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:39.341193 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411f83cc0aec47b886c9a41438e4d8b5'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:39.342699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:39.355322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1234/2489] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:39 2022] DELETE /identity/v3/users/411f83cc0aec47b886c9a41438e4d8b5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:39.361005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:39.361469 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:39.361568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:39.380719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:39.381916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:39.444889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1256/2490] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:39.457787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:39.459523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:39.524478 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aad64-f687-4004-8bf3-087300895251 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:39.528259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:39.528869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:39.529145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:39.529410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:39.539227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:39.540678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:39.550042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1235/2491] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:40.024958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:40.033963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:40.036703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:40.042691 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3895a-1a69-4054-b0b0-0f192658cc83 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:40.052618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:40.052926 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:40.053255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:40.053531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] PATH_INFO: `/v3/projects/c632d123c7294504bc5c0a4df1cabf35` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:40.054874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c632d123c7294504bc5c0a4df1cabf35)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:40.057100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:40.186782 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c632d123c7294504bc5c0a4df1cabf35', 'request_id': 'req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.194576 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c632d123c7294504bc5c0a4df1cabf35', 'request_id': 'req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.317839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c632d123c7294504bc5c0a4df1cabf35', 'request_id': 'req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.331355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] The token cache is being invalidate because project c632d123c7294504bc5c0a4df1cabf35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:40.331700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.332364 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.334059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1257/2492] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:40 2022] DELETE /identity/v3/projects/c632d123c7294504bc5c0a4df1cabf35 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:40.338470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:40.349924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714f4c-5714-442f-ada4-cb3a18bba376 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:40.420121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:40.420885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:40.421181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:40.421458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] PATH_INFO: `/v3/users/67477031ff6b4d65a6bed655d2b2bcdb` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:40.423105 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67477031ff6b4d65a6bed655d2b2bcdb)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:40.425088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:40.678482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67477031ff6b4d65a6bed655d2b2bcdb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.679177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67477031ff6b4d65a6bed655d2b2bcdb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.723468 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67477031ff6b4d65a6bed655d2b2bcdb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.799120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67477031ff6b4d65a6bed655d2b2bcdb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.803282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ebdc796-82bf-459c-b066-1b1e574347b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67477031ff6b4d65a6bed655d2b2bcdb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:40.823469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1236/2493] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:40 2022] DELETE /identity/v3/users/67477031ff6b4d65a6bed655d2b2bcdb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:41.478211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:41.480743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:41.495453 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e8a07-85b5-4de1-86d0-a4bf3ff7a745 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:41.563547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:41.564869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:41.565348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:41.565632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] PATH_INFO: `/v3/projects/7e708dfccc9144cfaea33279c7fb9b1b` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:41.566809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e708dfccc9144cfaea33279c7fb9b1b)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:41.568814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:41.701923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e708dfccc9144cfaea33279c7fb9b1b', 'request_id': 'req-03bef978-9a81-41ca-91db-852b124f97b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:41.710658 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e708dfccc9144cfaea33279c7fb9b1b', 'request_id': 'req-03bef978-9a81-41ca-91db-852b124f97b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:41.775101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e708dfccc9144cfaea33279c7fb9b1b', 'request_id': 'req-03bef978-9a81-41ca-91db-852b124f97b6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:41.791281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] The token cache is being invalidate because project 7e708dfccc9144cfaea33279c7fb9b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:41.791606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:41.792332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-03bef978-9a81-41ca-91db-852b124f97b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:41.797843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1258/2494] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:41 2022] DELETE /identity/v3/projects/7e708dfccc9144cfaea33279c7fb9b1b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:41.799991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1927-5994-4f52-aaf0-e7900e817fc6 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:41.800438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1927-5994-4f52-aaf0-e7900e817fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:41.800550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1927-5994-4f52-aaf0-e7900e817fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:41.829501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-d79a1927-5994-4f52-aaf0-e7900e817fc6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:41.831186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-d79a1927-5994-4f52-aaf0-e7900e817fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:41.847986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:41.923257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1237/2495] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:41.932688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c7b3-1f0e-47e5-8655-5f6973d1f9c0 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:41.932976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c7b3-1f0e-47e5-8655-5f6973d1f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:41.933352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4c7b3-1f0e-47e5-8655-5f6973d1f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:41.953817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-28f4c7b3-1f0e-47e5-8655-5f6973d1f9c0 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:41.955264 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-28f4c7b3-1f0e-47e5-8655-5f6973d1f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:41.963655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1259/2496] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:41.968037 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1927-5994-4f52-aaf0-e7900e817fc6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:41.979854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1927-5994-4f52-aaf0-e7900e817fc6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:41.985438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:41.986131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:41.986476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:41.986819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:41.987606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:41.988082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:41.989798 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:42.004602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1238/2497] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:42.009352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4c7b3-1f0e-47e5-8655-5f6973d1f9c0 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:42.031656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4c7b3-1f0e-47e5-8655-5f6973d1f9c0 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:42.038447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:42.039247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.039668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.040039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.041033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:42.043202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:42.051632 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:42.137178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1260/2498] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:42 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:42.142426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:42.152723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce148b8-f114-4f5c-b39d-5b6bf084f3bf admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:42.222621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:42.223708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.224552 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.225043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.227507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:42.230002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:42.290201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1239/2499] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:42 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:42.294495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:42.305204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1db3a4-a143-436a-8037-6038a91fd9e6 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:42.311258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:42.311915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.313285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.313285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.314094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:42.318476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:42.330313 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1261/2500] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:42.333971 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:42.344589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9c5c9-651d-4cff-8fa4-52134e9daf30 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:42.349914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7443b-7037-4604-a6aa-3b441a03bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:42.350720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7443b-7037-4604-a6aa-3b441a03bc2b admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.351379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7443b-7037-4604-a6aa-3b441a03bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.351604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7443b-7037-4604-a6aa-3b441a03bc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.352245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7443b-7037-4604-a6aa-3b441a03bc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:42.353835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7443b-7037-4604-a6aa-3b441a03bc2b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:42.373819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1240/2501] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:42.374054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:42.393514 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac99a99-cb17-4a34-80fb-42b346f5989d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:42.395901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:42.396838 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.397188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.397526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] PATH_INFO: `/v3/projects/041c924a256f4290977e431f3b77ca29/users/49f035fcca5046b9a1a5d1b3cb216938/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.418855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041c924a256f4290977e431f3b77ca29, user_id=49f035fcca5046b9a1a5d1b3cb216938, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:42.422356 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:42.508948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1262/2502] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:42 2022] PUT /identity/v3/projects/041c924a256f4290977e431f3b77ca29/users/49f035fcca5046b9a1a5d1b3cb216938/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:42.522292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff8bd-4131-4bae-9ea9-bc48f91dd06c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.522572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff8bd-4131-4bae-9ea9-bc48f91dd06c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.522983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ff8bd-4131-4bae-9ea9-bc48f91dd06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.555409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-449ff8bd-4131-4bae-9ea9-bc48f91dd06c None None] MFA Rules not processed for user `49f035fcca5046b9a1a5d1b3cb216938`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:42.556574 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-449ff8bd-4131-4bae-9ea9-bc48f91dd06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:42.639222 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1241/2503] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:42.644456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:42.737105 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331739-b91a-4296-a6cc-733a6de0f406 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:42.743221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:42.744300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.744815 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.745640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.746592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:42.749174 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:42.851283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1263/2504] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:42 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:42.855883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff8bd-4131-4bae-9ea9-bc48f91dd06c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:42.888896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ff8bd-4131-4bae-9ea9-bc48f91dd06c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:42.893497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:42.981368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:42.982862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:42.983353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:42.983887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:42.985522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:42.988150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:43.097702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1242/2505] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:42 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:43.101870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:43.113223 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509b7ae-fd07-4485-a4f2-bceb70876249 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:43.121161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:43.121161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:43.121161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:43.121161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:43.121780 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:43.123311 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:43.135958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1264/2506] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:43.140355 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:43.151125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755242e-0850-42a6-a7aa-c71f4ef6e638 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:43.155951 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:43.156670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:43.156957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:43.157388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] PATH_INFO: `/v3/projects/b42e4317c808420d98abaa584698f968/users/f159b244e9304a7c872e9dcb0ac2230f/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:43.174796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42e4317c808420d98abaa584698f968, user_id=f159b244e9304a7c872e9dcb0ac2230f, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:43.184381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:43.256744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1243/2507] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:43 2022] PUT /identity/v3/projects/b42e4317c808420d98abaa584698f968/users/f159b244e9304a7c872e9dcb0ac2230f/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:43.260975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:43.272631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245367d-d7f0-448f-a59a-e2f81925c9b3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:43.346214 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a53b81-de1a-4503-8806-52623400c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:43.346745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53b81-de1a-4503-8806-52623400c7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:43.347025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53b81-de1a-4503-8806-52623400c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:43.347295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53b81-de1a-4503-8806-52623400c7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:43.347968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a53b81-de1a-4503-8806-52623400c7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:43.349557 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a53b81-de1a-4503-8806-52623400c7e0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:43.360400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1265/2508] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:43.364501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:43.376457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953f3ee-cc1a-4e14-b7a9-49cb7bdd7ece admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:43.381283 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:43.382013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:43.382364 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:43.382701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] PATH_INFO: `/v3/projects/b42e4317c808420d98abaa584698f968/users/f159b244e9304a7c872e9dcb0ac2230f/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:43.384691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42e4317c808420d98abaa584698f968, user_id=f159b244e9304a7c872e9dcb0ac2230f, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:43.387314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:43.399452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1244/2509] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:43 2022] PUT /identity/v3/projects/b42e4317c808420d98abaa584698f968/users/f159b244e9304a7c872e9dcb0ac2230f/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:43.408932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca1bf-d97f-4b87-aa37-242ff64c2e95 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:43.409221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca1bf-d97f-4b87-aa37-242ff64c2e95 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:43.409500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afca1bf-d97f-4b87-aa37-242ff64c2e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:43.445046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-7afca1bf-d97f-4b87-aa37-242ff64c2e95 None None] MFA Rules not processed for user `f159b244e9304a7c872e9dcb0ac2230f`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:43.446292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7afca1bf-d97f-4b87-aa37-242ff64c2e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:43.458003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:43.533275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1266/2510] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:55:43.544940 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:43.547499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:43.633370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b8dc4-cd19-4201-aa18-e6ce910e2d17 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:43.638073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:43.638851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:43.645238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:43.645238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:43.658559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:43.667150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:43.670513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1245/2511] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:44.556094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0bbb3-d3e4-4b42-abe5-6f0d4b91a374 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:44.556595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0bbb3-d3e4-4b42-abe5-6f0d4b91a374 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:44.556683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0bbb3-d3e4-4b42-abe5-6f0d4b91a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:44.588550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-22e0bbb3-d3e4-4b42-abe5-6f0d4b91a374 None None] MFA Rules not processed for user `134a05b72b5c403d88f2e0c2034532d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:44.589791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-22e0bbb3-d3e4-4b42-abe5-6f0d4b91a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:44.663577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1267/2512] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:44.666160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:44.668018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:44.738043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91872b6b-6961-408c-9d9f-61875e709026 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:44.742585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:44.743189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:44.743502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:44.743782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:44.744447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:44.746334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:44.752260 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:44.854936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1246/2513] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:44 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:44.856055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0bbb3-d3e4-4b42-abe5-6f0d4b91a374 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:44.867978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0bbb3-d3e4-4b42-abe5-6f0d4b91a374 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:44.934999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:44.935716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:44.936150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:44.936485 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:44.937191 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:44.939200 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:45.058620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1268/2514] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:44 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:45.063859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:45.083188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1e0a7-c920-4b39-964a-f698d0a0db86 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:45.101378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:45.102264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:45.102700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:45.103173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:45.104069 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:45.105954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:45.121346 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1247/2515] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:55:45.131339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:45.151727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:45.185280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d372e4-a2db-41ec-b2a8-8869790e423f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:45.190438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:45.191156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:45.191458 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:45.191738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] PATH_INFO: `/v3/projects/2c833bc91ba544daa213f4874323d94c/users/6d50a984ecc045a0bfb0482c4789af29/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:45.207069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c833bc91ba544daa213f4874323d94c, user_id=6d50a984ecc045a0bfb0482c4789af29, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:45.209744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:45.283823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1269/2516] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:45 2022] PUT /identity/v3/projects/2c833bc91ba544daa213f4874323d94c/users/6d50a984ecc045a0bfb0482c4789af29/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:45.288025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:45.334144 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380d6b-87c3-4031-ab68-310e668b1a13 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:45.411754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:45.411754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:45.411754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:45.411754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:45.412127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:45.412127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:45.424286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1248/2517] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:45.429178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:45.443334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02687684-a190-4794-95b0-d53adf9ba57f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:45.450284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f6cbf-1538-4b66-a9cd-b897ab767086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:45.451479 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6cbf-1538-4b66-a9cd-b897ab767086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:45.451622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6cbf-1538-4b66-a9cd-b897ab767086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:45.451846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6cbf-1538-4b66-a9cd-b897ab767086 admin admin] PATH_INFO: `/v3/projects/2c833bc91ba544daa213f4874323d94c/users/6d50a984ecc045a0bfb0482c4789af29/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:45.455307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f6cbf-1538-4b66-a9cd-b897ab767086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c833bc91ba544daa213f4874323d94c, user_id=6d50a984ecc045a0bfb0482c4789af29, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:45.458087 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f6cbf-1538-4b66-a9cd-b897ab767086 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:45.476828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1270/2518] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:45 2022] PUT /identity/v3/projects/2c833bc91ba544daa213f4874323d94c/users/6d50a984ecc045a0bfb0482c4789af29/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:46.848087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:46.861660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1401ab-f5f2-4141-858b-19e0ce0a5daa admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:46.923227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:46.924065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:46.924434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:46.924941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] PATH_INFO: `/v3/users/49f035fcca5046b9a1a5d1b3cb216938` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:46.926201 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f035fcca5046b9a1a5d1b3cb216938)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:46.928363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:47.137815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:47.143325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f035fcca5046b9a1a5d1b3cb216938'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:47.144008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f035fcca5046b9a1a5d1b3cb216938'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:47.155851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f035fcca5046b9a1a5d1b3cb216938'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:47.238094 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f035fcca5046b9a1a5d1b3cb216938'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:47.239670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f035fcca5046b9a1a5d1b3cb216938'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:47.258176 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1249/2519] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:46 2022] DELETE /identity/v3/users/49f035fcca5046b9a1a5d1b3cb216938 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:47.259908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:47.260415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:47.260501 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:47.306406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:47.307774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:47.385918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1271/2520] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:47.397170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:47.399303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:47.508512 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce49d7-badb-405a-be28-6ccd6103ca14 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:47.513006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:47.513941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:47.513941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:47.514188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:47.524067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:47.525517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:47.536131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1250/2521] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:48.318306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:48.319762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:48.338306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d201f8e-9bb4-423a-8d92-0585bacf5efc None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:48.347482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:48.348394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:48.349135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:48.349584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] PATH_INFO: `/v3/projects/041c924a256f4290977e431f3b77ca29` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:48.351036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041c924a256f4290977e431f3b77ca29)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:48.354990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:48.466078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041c924a256f4290977e431f3b77ca29', 'request_id': 'req-5ed12f40-1173-4c25-9396-05cf23d8aa10'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:48.477096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041c924a256f4290977e431f3b77ca29', 'request_id': 'req-5ed12f40-1173-4c25-9396-05cf23d8aa10'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:48.592153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041c924a256f4290977e431f3b77ca29', 'request_id': 'req-5ed12f40-1173-4c25-9396-05cf23d8aa10'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:48.607260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] The token cache is being invalidate because project 041c924a256f4290977e431f3b77ca29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:48.608008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:48.608863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:48.610877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1272/2522] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:48 2022] DELETE /identity/v3/projects/041c924a256f4290977e431f3b77ca29 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:48.615397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:48.630040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9faef-1126-4353-909a-93cfad2654a0 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:48.718430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:48.719782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:48.720168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:48.720446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] PATH_INFO: `/v3/users/f159b244e9304a7c872e9dcb0ac2230f` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:48.721714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f159b244e9304a7c872e9dcb0ac2230f)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:48.723860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:48.834255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:48.936019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f159b244e9304a7c872e9dcb0ac2230f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:48.936698 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f159b244e9304a7c872e9dcb0ac2230f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:48.950786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f159b244e9304a7c872e9dcb0ac2230f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:49.026394 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f159b244e9304a7c872e9dcb0ac2230f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:49.027079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-08715a22-76a9-4617-b230-2ae17a2735cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f159b244e9304a7c872e9dcb0ac2230f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:49.044432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1251/2523] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:48 2022] DELETE /identity/v3/users/f159b244e9304a7c872e9dcb0ac2230f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:49.560432 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:49.561959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:49.611338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed12f40-1173-4c25-9396-05cf23d8aa10 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:49.616252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:49.704407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:49.705144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:49.705488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:49.706009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] PATH_INFO: `/v3/projects/b42e4317c808420d98abaa584698f968` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:49.707314 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42e4317c808420d98abaa584698f968)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:49.709587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:49.866862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42e4317c808420d98abaa584698f968', 'request_id': 'req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:49.875544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42e4317c808420d98abaa584698f968', 'request_id': 'req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:50.048265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42e4317c808420d98abaa584698f968', 'request_id': 'req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:50.067846 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] The token cache is being invalidate because project b42e4317c808420d98abaa584698f968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:50.069923 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:50.077467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2e7ad19e-5a4b-4d9d-918c-9dda5ca49002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:50.081794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1273/2524] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:49 2022] DELETE /identity/v3/projects/b42e4317c808420d98abaa584698f968 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:50.086330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf35f-f4f3-45cc-b85f-404bf10c5477 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.086871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf35f-f4f3-45cc-b85f-404bf10c5477 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.087081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaf35f-f4f3-45cc-b85f-404bf10c5477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.178287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2adaf35f-f4f3-45cc-b85f-404bf10c5477 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:50.179751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2adaf35f-f4f3-45cc-b85f-404bf10c5477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:50.268976 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1252/2525] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:50.283296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77af1-46e6-493f-ad45-f97ffd27360f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.283296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77af1-46e6-493f-ad45-f97ffd27360f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.283296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77af1-46e6-493f-ad45-f97ffd27360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.293189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-55c77af1-46e6-493f-ad45-f97ffd27360f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:50.294742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-55c77af1-46e6-493f-ad45-f97ffd27360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:50.309227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1274/2526] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:50.314588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaf35f-f4f3-45cc-b85f-404bf10c5477 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:50.324987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaf35f-f4f3-45cc-b85f-404bf10c5477 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:50.330521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:50.331179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.331520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.331794 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.332481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:55:50.333018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:50.337006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:50.352814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1253/2527] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:55:50.353084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c77af1-46e6-493f-ad45-f97ffd27360f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:50.365347 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c77af1-46e6-493f-ad45-f97ffd27360f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:50.371951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:50.372756 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.373285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.381213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.381982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:50.387714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:50.514757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:50.523708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1275/2528] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:50 2022] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:50.529978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadabdeb-8a06-415a-badd-087787da492c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:50.654264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:50.661484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.661484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.661484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.661484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:50.661484 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:50.750289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:50.756579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1254/2529] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:50 2022] POST /identity/v3/users => generated 301 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:50.759953 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:50.777033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09acf1-55b3-4c0c-8952-737ef20fa533 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:50.783378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:50.784260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.784686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.785054 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.785802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:50.787528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:50.804446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:50.805993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1276/2530] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:50.815386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a755d-7107-450b-bd6b-903dacfb9e2e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:50.821205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833e950-a533-4816-917f-74561d194b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:50.821897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833e950-a533-4816-917f-74561d194b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.822242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833e950-a533-4816-917f-74561d194b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.822579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833e950-a533-4816-917f-74561d194b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.823297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833e950-a533-4816-917f-74561d194b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:50.825080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833e950-a533-4816-917f-74561d194b9b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:50.837052 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1255/2531] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:50.842262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:50.855866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268afd9f-06cc-4506-be70-74748aaa46d7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:50.861713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:50.862375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.862651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.862921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] PATH_INFO: `/v3/projects/d0c6e1883c55462394d243256f8112e1/users/0b67e4d68ce94caaa7edbe12a4977307/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.879987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c6e1883c55462394d243256f8112e1, user_id=0b67e4d68ce94caaa7edbe12a4977307, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:50.882562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:50.929944 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1277/2532] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:50 2022] PUT /identity/v3/projects/d0c6e1883c55462394d243256f8112e1/users/0b67e4d68ce94caaa7edbe12a4977307/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:50.941361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b814ce9-063b-41b9-b7db-e7c13bfc1833 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:50.941647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b814ce9-063b-41b9-b7db-e7c13bfc1833 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:50.941985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b814ce9-063b-41b9-b7db-e7c13bfc1833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:50.976629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6b814ce9-063b-41b9-b7db-e7c13bfc1833 None None] MFA Rules not processed for user `0b67e4d68ce94caaa7edbe12a4977307`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:50.977952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6b814ce9-063b-41b9-b7db-e7c13bfc1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:51.052999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1256/2533] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:51.057573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:51.090876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:51.131934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acfd81-032e-49f5-a581-26447bc93b71 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:51.137011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:51.138088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.138372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.138644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.139487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:51.142135 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:51.201093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1278/2534] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:55:51 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:55:51.206922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b814ce9-063b-41b9-b7db-e7c13bfc1833 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:51.221956 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b814ce9-063b-41b9-b7db-e7c13bfc1833 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:51.342267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:51.343084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.343376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.344290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.344669 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:51.354247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:51.416188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1257/2535] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:55:51 2022] POST /identity/v3/users => generated 307 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:55:51.422635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:51.436440 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f0a81-7892-43fe-acc3-4b38cff449e9 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:51.447090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:51.450727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.450727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.450727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.450727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:51.451468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:51.471860 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1279/2536] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:51.472367 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:51.488114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2133b12-1e73-4eb8-b2fe-76632965e26c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:51.496070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:51.496775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.497061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.497342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] PATH_INFO: `/v3/projects/2189eccad83d40c6b0bbab3f06376815/users/e823e860d3f141cd949cf3764ca753c8/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.522174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2189eccad83d40c6b0bbab3f06376815, user_id=e823e860d3f141cd949cf3764ca753c8, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:51.525335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:51.603879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1258/2537] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:51 2022] PUT /identity/v3/projects/2189eccad83d40c6b0bbab3f06376815/users/e823e860d3f141cd949cf3764ca753c8/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:55:51.608069 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:51.619913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573634c-92f5-455b-a65f-f4fff7d56186 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:51.661188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:51.663118 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:51.699504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:51.700475 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.700637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.701010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.701769 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:51.703847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:51.721629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1280/2538] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:55:51.723536 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:51.731865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:51.737935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bd4b9-eea4-422f-9984-84bffcc9f8f7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:51.744713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ddb59-1f3a-43bd-94e7-7c82f3e6774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:51.745607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ddb59-1f3a-43bd-94e7-7c82f3e6774f admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.745740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ddb59-1f3a-43bd-94e7-7c82f3e6774f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.746082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ddb59-1f3a-43bd-94e7-7c82f3e6774f admin admin] PATH_INFO: `/v3/projects/2189eccad83d40c6b0bbab3f06376815/users/e823e860d3f141cd949cf3764ca753c8/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.748139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ddb59-1f3a-43bd-94e7-7c82f3e6774f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2189eccad83d40c6b0bbab3f06376815, user_id=e823e860d3f141cd949cf3764ca753c8, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:51.751008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ddb59-1f3a-43bd-94e7-7c82f3e6774f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:51.774419 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ad63-17ed-4d36-8e49-4ef8d96bd31a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:51.779927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1281/2539] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:55:51 2022] PUT /identity/v3/projects/2189eccad83d40c6b0bbab3f06376815/users/e823e860d3f141cd949cf3764ca753c8/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:51.783766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb9d3-08f6-45d5-a728-08a8a5621706 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.784194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb9d3-08f6-45d5-a728-08a8a5621706 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.784565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb9d3-08f6-45d5-a728-08a8a5621706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.826279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-74fcb9d3-08f6-45d5-a728-08a8a5621706 None None] MFA Rules not processed for user `e823e860d3f141cd949cf3764ca753c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:51.832982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-74fcb9d3-08f6-45d5-a728-08a8a5621706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:51.925983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:51.931589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.931589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.931589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.931589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:51.949628 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1282/2540] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:51 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:51.953365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:51.953365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:51.953365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:51.971334 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:51.988273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] MFA Rules not processed for user `6d50a984ecc045a0bfb0482c4789af29`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:51.989669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:52.013904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:52.016352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:52.028871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1259/2541] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:52.029769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:52.031617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:52.097328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1283/2542] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:52.112718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:52.114483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:52.132443 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafdba-dc72-478c-8e35-cec5d45257a3 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:52.138627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b0dd-01bc-49ef-8785-c43a21c15253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:52.139322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b0dd-01bc-49ef-8785-c43a21c15253 service nova] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:52.139735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b0dd-01bc-49ef-8785-c43a21c15253 service nova] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:52.140077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b0dd-01bc-49ef-8785-c43a21c15253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:52.142992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b538b0dd-01bc-49ef-8785-c43a21c15253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:52.144205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca504d-74b5-4370-aa72-7defae3d2afc service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:52.148622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:52.149257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:52.149631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:52.149979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:52.160224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:52.161928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:52.167886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:52.174207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1260/2543] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:52 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:52.245250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538b0dd-01bc-49ef-8785-c43a21c15253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:52.247393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538b0dd-01bc-49ef-8785-c43a21c15253 service nova] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:52.266332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1284/2544] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:52.361347 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:52.369968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf752-4da1-4dea-8cb3-7c2ca606d21c service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:52.375588 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:52.376148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:52.377107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:52.377107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:52.436851 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:52.439200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:52.448674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1261/2545] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:55:55.044494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650463f-dd00-41ec-8f16-c71fdf780234 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:55.045373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650463f-dd00-41ec-8f16-c71fdf780234 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:55.045646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650463f-dd00-41ec-8f16-c71fdf780234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:55.067870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-a650463f-dd00-41ec-8f16-c71fdf780234 None None] MFA Rules not processed for user `134a05b72b5c403d88f2e0c2034532d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:55.069283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a650463f-dd00-41ec-8f16-c71fdf780234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:55.076690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1285/2546] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:57.743550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:57.809238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4517bb-dd66-4a83-acbc-74305a1f238c service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:57.813991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:57.814666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:57.814944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:57.815217 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] PATH_INFO: `/v3/users/0b67e4d68ce94caaa7edbe12a4977307` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:57.816386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b67e4d68ce94caaa7edbe12a4977307)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:57.818315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:58.055400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b67e4d68ce94caaa7edbe12a4977307'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:58.056320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b67e4d68ce94caaa7edbe12a4977307'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:58.070425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b67e4d68ce94caaa7edbe12a4977307'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:58.151828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b67e4d68ce94caaa7edbe12a4977307'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:58.152539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b67e4d68ce94caaa7edbe12a4977307'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:58.166695 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1262/2547] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:57 2022] DELETE /identity/v3/users/0b67e4d68ce94caaa7edbe12a4977307 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:58.171170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:58.172329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:58.172329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:58.192748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:55:58.193947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:58.264500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1286/2548] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:55:58.274229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:58.275743 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:58.297757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:58.340379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee5bf0-aced-4116-8878-9e9a48668e66 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:58.347579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:58.348247 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:58.348530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:58.348829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:58.359436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:58.361274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:58.371032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1263/2549] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:55:58.805185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:58.806816 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:55:58.822176 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77727190-5f8d-47fb-b2eb-837113fcb067 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:58.832389 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:58.833384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:58.834013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:58.834559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] PATH_INFO: `/v3/projects/d0c6e1883c55462394d243256f8112e1` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:58.836209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c6e1883c55462394d243256f8112e1)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:58.840690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:58.864484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:59.204497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c6e1883c55462394d243256f8112e1', 'request_id': 'req-6b956c98-6dcd-4612-a524-52cd67a21d5f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.210851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c6e1883c55462394d243256f8112e1', 'request_id': 'req-6b956c98-6dcd-4612-a524-52cd67a21d5f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.284295 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c6e1883c55462394d243256f8112e1', 'request_id': 'req-6b956c98-6dcd-4612-a524-52cd67a21d5f'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.298708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] The token cache is being invalidate because project d0c6e1883c55462394d243256f8112e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:55:59.299022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.299829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.301666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1287/2550] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:55:58 2022] DELETE /identity/v3/projects/d0c6e1883c55462394d243256f8112e1 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:55:59.305775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:55:59.316426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0628b99-9c0d-4e80-8545-6da208b76540 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:55:59.386424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:55:59.387145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:55:59.387647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:55:59.388001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] PATH_INFO: `/v3/users/e823e860d3f141cd949cf3764ca753c8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:55:59.390018 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e823e860d3f141cd949cf3764ca753c8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:55:59.393424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:55:59.585400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e823e860d3f141cd949cf3764ca753c8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.586083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e823e860d3f141cd949cf3764ca753c8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.599697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e823e860d3f141cd949cf3764ca753c8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.649089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e823e860d3f141cd949cf3764ca753c8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.650174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c6a2bc55-9109-4320-876e-47194a5fb1e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e823e860d3f141cd949cf3764ca753c8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:55:59.664102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1264/2551] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:55:59 2022] DELETE /identity/v3/users/e823e860d3f141cd949cf3764ca753c8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:00.091872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:00.093561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:00.108373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956c98-6dcd-4612-a524-52cd67a21d5f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:00.177942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:00.178545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.178881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.179161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] PATH_INFO: `/v3/projects/2189eccad83d40c6b0bbab3f06376815` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.180318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2189eccad83d40c6b0bbab3f06376815)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:00.182233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:00.288961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2189eccad83d40c6b0bbab3f06376815', 'request_id': 'req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:00.295384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2189eccad83d40c6b0bbab3f06376815', 'request_id': 'req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:00.362943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2189eccad83d40c6b0bbab3f06376815', 'request_id': 'req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:00.380665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] The token cache is being invalidate because project 2189eccad83d40c6b0bbab3f06376815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:00.380963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:00.382041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c9a0e0f4-80b1-43a7-86fe-2077dbe1f76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:00.383637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1288/2552] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:00 2022] DELETE /identity/v3/projects/2189eccad83d40c6b0bbab3f06376815 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:00.393962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42453-c302-4e55-992a-c8ab4cb0e978 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.393962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42453-c302-4e55-992a-c8ab4cb0e978 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.393962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42453-c302-4e55-992a-c8ab4cb0e978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.409870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f8d42453-c302-4e55-992a-c8ab4cb0e978 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:00.411082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f8d42453-c302-4e55-992a-c8ab4cb0e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:00.446372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:00.474309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1265/2553] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:00.481849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8a042-e105-41ae-8293-db26870d23f3 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.482164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8a042-e105-41ae-8293-db26870d23f3 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.484688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8a042-e105-41ae-8293-db26870d23f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.509980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-50a8a042-e105-41ae-8293-db26870d23f3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:00.511285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-50a8a042-e105-41ae-8293-db26870d23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:00.519729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1289/2554] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:00.524088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d42453-c302-4e55-992a-c8ab4cb0e978 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:00.533894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d42453-c302-4e55-992a-c8ab4cb0e978 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:00.540649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:00.547703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.547703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.547703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.547703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:00.547703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:00.547703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:00.563469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1266/2555] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:56:00.570864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8a042-e105-41ae-8293-db26870d23f3 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:00.574864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8a042-e105-41ae-8293-db26870d23f3 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:00.580292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:00.580981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.581327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.581663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.582398 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:00.584489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:00.698133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1290/2556] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:00 2022] POST /identity/v3/projects => generated 407 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:00.700978 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:00.713749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87068c3-1ba4-4485-b43e-1be95b68139b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:00.785860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:00.786471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.786779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.787006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.787664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:00.789604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:00.872551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1267/2557] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:00 2022] POST /identity/v3/users => generated 304 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:00.876911 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:00.888435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4461-dc63-4397-a4bd-e79e7052cddf admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:00.907039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:00.907039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.907039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.907039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.908459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:00.908459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:00.908459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:00.920304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1291/2558] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:00.925587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:00.938696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285d6b5-3522-472a-847c-b5dc53647b40 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:00.943724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0880-2344-4d19-92ee-b608b77131ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:00.944416 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0880-2344-4d19-92ee-b608b77131ea admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.944852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0880-2344-4d19-92ee-b608b77131ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.945291 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0880-2344-4d19-92ee-b608b77131ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.945947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0880-2344-4d19-92ee-b608b77131ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:00.947563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0880-2344-4d19-92ee-b608b77131ea admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:00.959306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1268/2559] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:00.964113 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:00.976975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d24166-8b64-4f1a-8d9e-f0d3b60f04bd admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:00.981701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:00.982355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:00.982635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:00.982908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] PATH_INFO: `/v3/projects/46b754f467664d0495e610e8ce652e8b/users/209b5263ca1544cf9110d253c05d1b6c/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:00.998441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b754f467664d0495e610e8ce652e8b, user_id=209b5263ca1544cf9110d253c05d1b6c, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:01.001556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:01.049772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1292/2560] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:00 2022] PUT /identity/v3/projects/46b754f467664d0495e610e8ce652e8b/users/209b5263ca1544cf9110d253c05d1b6c/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:01.060166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452b998-f878-4486-a0e8-72010baf77de None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.060459 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452b998-f878-4486-a0e8-72010baf77de None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.060739 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452b998-f878-4486-a0e8-72010baf77de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.091211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f452b998-f878-4486-a0e8-72010baf77de None None] MFA Rules not processed for user `209b5263ca1544cf9110d253c05d1b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:01.092474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f452b998-f878-4486-a0e8-72010baf77de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:01.160441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1269/2561] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:01.164955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:01.233821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc9d2-968e-4298-b9eb-7340cc4677ae admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:01.242007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:01.242638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.242968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.243301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.246251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:01.246251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:01.319014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1293/2562] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:01 2022] POST /identity/v3/projects => generated 409 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:01.323147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452b998-f878-4486-a0e8-72010baf77de None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:01.334645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452b998-f878-4486-a0e8-72010baf77de None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:01.368041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:01.392716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:01.393387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.393704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.393999 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.394629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:01.396778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:01.480722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1270/2563] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:01 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:01.482226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:01.492890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f3dd-6c20-44ca-b13c-f5c4bf669c96 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:01.497745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:01.498503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.498783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.499060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.499765 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:01.501901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:01.512789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1294/2564] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:01.518034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:01.529257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f6daf-3d9b-4c4e-8d09-49f5af44d1d1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:01.534162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:01.534836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.535117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.535389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] PATH_INFO: `/v3/projects/4a1025c7837948a79db69c9f862a5dc1/users/88ef59aa78324ecd8ce0f5b2c563f3d2/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.550290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1025c7837948a79db69c9f862a5dc1, user_id=88ef59aa78324ecd8ce0f5b2c563f3d2, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:01.553153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:01.649569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1271/2565] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:01 2022] PUT /identity/v3/projects/4a1025c7837948a79db69c9f862a5dc1/users/88ef59aa78324ecd8ce0f5b2c563f3d2/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:01.653553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:01.665086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6485bb5-e5d1-479a-bcbc-1ad48219527d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:01.730572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ac784-58c5-4018-83ee-a1e209ba76c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:01.731178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac784-58c5-4018-83ee-a1e209ba76c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.731487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac784-58c5-4018-83ee-a1e209ba76c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.731763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ac784-58c5-4018-83ee-a1e209ba76c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.732450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ac784-58c5-4018-83ee-a1e209ba76c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:01.734021 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ac784-58c5-4018-83ee-a1e209ba76c1 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:01.746140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1295/2566] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:01.750406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:01.761920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c765a2b-2dac-4954-97d2-c596e79dad71 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:01.766777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:01.767362 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.767672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.767947 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] PATH_INFO: `/v3/projects/4a1025c7837948a79db69c9f862a5dc1/users/88ef59aa78324ecd8ce0f5b2c563f3d2/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.769847 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1025c7837948a79db69c9f862a5dc1, user_id=88ef59aa78324ecd8ce0f5b2c563f3d2, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:01.772516 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:01.783385 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1272/2567] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:01 2022] PUT /identity/v3/projects/4a1025c7837948a79db69c9f862a5dc1/users/88ef59aa78324ecd8ce0f5b2c563f3d2/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:01.795304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.795714 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.795915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:01.825330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] MFA Rules not processed for user `88ef59aa78324ecd8ce0f5b2c563f3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:01.826586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:01.864097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:01.904635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1296/2568] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:01.927924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:01.929825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:01.994793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c628-257b-4c68-ac33-ae344825e869 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:01.998580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefcc9f-758d-4f68-a04f-16bc1911c1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:01.999188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefcc9f-758d-4f68-a04f-16bc1911c1fe service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:01.999497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefcc9f-758d-4f68-a04f-16bc1911c1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:01.999776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefcc9f-758d-4f68-a04f-16bc1911c1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:02.009559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefcc9f-758d-4f68-a04f-16bc1911c1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:02.010975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefcc9f-758d-4f68-a04f-16bc1911c1fe service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:02.024893 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1273/2569] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:02.318876 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:02.320570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:02.348444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b216c-67f1-4165-b1cd-b40c4426e041 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:02.355397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:02.357120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:02.357120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:02.357120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:02.418428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:02.419904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:02.430303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1297/2570] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:02 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:02.477483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952bcc-c889-4385-84ea-8734e4651f0e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:02.477483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952bcc-c889-4385-84ea-8734e4651f0e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:02.477483 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952bcc-c889-4385-84ea-8734e4651f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:02.513340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-dc952bcc-c889-4385-84ea-8734e4651f0e None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:02.514724 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-dc952bcc-c889-4385-84ea-8734e4651f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:02.584184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1274/2571] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:56:02.761777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:02.763488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:02.844005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19991-3e48-4800-8364-44d6287532f4 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:02.851281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0158-d2c1-4ad5-ab5f-97223abe20e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:02.852109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0158-d2c1-4ad5-ab5f-97223abe20e7 service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:02.852610 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0158-d2c1-4ad5-ab5f-97223abe20e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:02.853068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0158-d2c1-4ad5-ab5f-97223abe20e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:02.864430 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a0158-d2c1-4ad5-ab5f-97223abe20e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:02.866119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a0158-d2c1-4ad5-ab5f-97223abe20e7 service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:02.874678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1298/2572] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:56:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:56:10.107850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952bcc-c889-4385-84ea-8734e4651f0e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:10.137534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:10.177603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952bcc-c889-4385-84ea-8734e4651f0e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:10.182132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:10.182783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:10.183057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:10.183380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] PATH_INFO: `/v3/users/209b5263ca1544cf9110d253c05d1b6c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:10.184551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209b5263ca1544cf9110d253c05d1b6c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:10.186630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:10.701735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209b5263ca1544cf9110d253c05d1b6c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:10.702725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209b5263ca1544cf9110d253c05d1b6c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:10.721637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209b5263ca1544cf9110d253c05d1b6c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:10.797106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209b5263ca1544cf9110d253c05d1b6c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:10.797991 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209b5263ca1544cf9110d253c05d1b6c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:10.826132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1275/2573] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:10 2022] DELETE /identity/v3/users/209b5263ca1544cf9110d253c05d1b6c => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:10.827934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c76b35-2c18-4650-9824-d0a348001bb8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:10.828446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c76b35-2c18-4650-9824-d0a348001bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:10.828852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c76b35-2c18-4650-9824-d0a348001bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:10.851331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-15c76b35-2c18-4650-9824-d0a348001bb8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:10.852726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-15c76b35-2c18-4650-9824-d0a348001bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:10.923097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:10.938093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1299/2574] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:10.950075 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:10.952856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:11.022825 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c169d8-82a9-4a3c-8ba2-e3a86ee9c0e5 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:11.033837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:11.034494 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:11.035078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:11.035078 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:11.060117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:11.061827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:11.074434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1276/2575] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:11.483111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c76b35-2c18-4650-9824-d0a348001bb8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:11.499637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c76b35-2c18-4650-9824-d0a348001bb8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:11.504615 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:11.506043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:11.506426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:11.506934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:11.509906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:11.526034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:11.529183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:11.555667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1300/2576] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:11.622772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:11.626465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:11.654330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7d6cf-bac5-4495-ac10-65e6555ffa13 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:11.673943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:11.674636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:11.675151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:11.675299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] PATH_INFO: `/v3/projects/46b754f467664d0495e610e8ce652e8b` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:11.676585 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b754f467664d0495e610e8ce652e8b)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:11.679167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:11.805480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:11.811530 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b754f467664d0495e610e8ce652e8b', 'request_id': 'req-fe91039f-16ec-4cd1-a72a-76fa8102c16c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:11.819975 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b754f467664d0495e610e8ce652e8b', 'request_id': 'req-fe91039f-16ec-4cd1-a72a-76fa8102c16c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:11.934441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b754f467664d0495e610e8ce652e8b', 'request_id': 'req-fe91039f-16ec-4cd1-a72a-76fa8102c16c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:11.959023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] The token cache is being invalidate because project 46b754f467664d0495e610e8ce652e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:11.959466 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:11.961862 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:11.966572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1277/2577] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:11 2022] DELETE /identity/v3/projects/46b754f467664d0495e610e8ce652e8b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:11.968049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:11.979822 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c568-b162-4a1f-8a4b-f5129a28e780 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:12.060183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:12.061459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:12.061752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:12.062033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] PATH_INFO: `/v3/users/88ef59aa78324ecd8ce0f5b2c563f3d2` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:12.063513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ef59aa78324ecd8ce0f5b2c563f3d2)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:12.066521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:12.306593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ef59aa78324ecd8ce0f5b2c563f3d2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:12.307864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ef59aa78324ecd8ce0f5b2c563f3d2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:12.336466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ef59aa78324ecd8ce0f5b2c563f3d2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:12.403377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ef59aa78324ecd8ce0f5b2c563f3d2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:12.404206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ac65916b-1e71-49d0-8b52-6d94d132a91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ef59aa78324ecd8ce0f5b2c563f3d2'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:12.419958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1301/2578] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:11 2022] DELETE /identity/v3/users/88ef59aa78324ecd8ce0f5b2c563f3d2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:12.990867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:12.993627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:13.041610 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91039f-16ec-4cd1-a72a-76fa8102c16c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:13.133055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:13.133738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:13.134019 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:13.134317 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] PATH_INFO: `/v3/projects/4a1025c7837948a79db69c9f862a5dc1` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:13.135637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1025c7837948a79db69c9f862a5dc1)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:13.137577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:13.289913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1025c7837948a79db69c9f862a5dc1', 'request_id': 'req-58c5be55-979f-40f6-acb7-cb8ab41ae54a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:13.299678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1025c7837948a79db69c9f862a5dc1', 'request_id': 'req-58c5be55-979f-40f6-acb7-cb8ab41ae54a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:13.375175 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1025c7837948a79db69c9f862a5dc1', 'request_id': 'req-58c5be55-979f-40f6-acb7-cb8ab41ae54a'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:13.395060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] The token cache is being invalidate because project 4a1025c7837948a79db69c9f862a5dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:13.396600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:13.399375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-58c5be55-979f-40f6-acb7-cb8ab41ae54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:13.402436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1278/2579] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:12 2022] DELETE /identity/v3/projects/4a1025c7837948a79db69c9f862a5dc1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:13.407372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04341-8284-4dfc-b465-c7346231cb15 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:13.408614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04341-8284-4dfc-b465-c7346231cb15 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:13.408937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04341-8284-4dfc-b465-c7346231cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:13.451441 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9de04341-8284-4dfc-b465-c7346231cb15 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:13.452849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9de04341-8284-4dfc-b465-c7346231cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:13.558969 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1302/2580] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:13.566830 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188634df-f895-4472-b65d-756c4131081b None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:13.567381 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188634df-f895-4472-b65d-756c4131081b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:13.567898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188634df-f895-4472-b65d-756c4131081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:13.599603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-188634df-f895-4472-b65d-756c4131081b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:13.601040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-188634df-f895-4472-b65d-756c4131081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:13.610268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1279/2581] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:56:13.615379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de04341-8284-4dfc-b465-c7346231cb15 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:13.628836 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:13.634129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de04341-8284-4dfc-b465-c7346231cb15 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:13.640662 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:13.641375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:13.641737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:13.642093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:13.643239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:13.643666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:13.645638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:13.666478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1303/2582] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:56:13.672525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188634df-f895-4472-b65d-756c4131081b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:13.690417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188634df-f895-4472-b65d-756c4131081b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:13.704783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:13.706044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:13.706331 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:13.706604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:13.708329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:13.710228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:13.808864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1280/2583] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:13 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:13.813377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:13.826147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d091e8-0f97-407c-8341-c804bee91a17 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:13.937935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:13.940266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:13.943959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:13.943959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:13.943959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:13.956994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:14.089871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1304/2584] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:13 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:14.094487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:14.116805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a378b7a-863b-4209-b765-010118facf98 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:14.122405 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:14.123022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:14.123299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:14.123618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:14.124262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:14.125962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:14.139472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1281/2585] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:14.143507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:14.157677 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82eb4e-5364-44c1-9891-999992d6cfb7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:14.165749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc9c1e-9608-49dd-83d6-fe56691f0d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:14.166380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc9c1e-9608-49dd-83d6-fe56691f0d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:14.166668 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc9c1e-9608-49dd-83d6-fe56691f0d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:14.167086 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc9c1e-9608-49dd-83d6-fe56691f0d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:14.168067 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc9c1e-9608-49dd-83d6-fe56691f0d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:14.169754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc9c1e-9608-49dd-83d6-fe56691f0d2a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:14.187310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:14.194204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1305/2586] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:14.199041 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0759ed6-e8e3-4268-bfad-2ddf4e44510e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:14.208398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:14.209256 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:14.209690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:14.210064 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] PATH_INFO: `/v3/projects/613efc2838734a61900298b97c772bb8/users/3e9e880f6a804116984b21afd1d301cd/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:14.234242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=613efc2838734a61900298b97c772bb8, user_id=3e9e880f6a804116984b21afd1d301cd, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:14.238109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:14.373812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:14.381067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1282/2587] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:14 2022] PUT /identity/v3/projects/613efc2838734a61900298b97c772bb8/users/3e9e880f6a804116984b21afd1d301cd/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:14.393803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea8cf-5551-48a7-831d-26261aefd69f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:14.394101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea8cf-5551-48a7-831d-26261aefd69f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:14.394373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea8cf-5551-48a7-831d-26261aefd69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:14.454255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-176ea8cf-5551-48a7-831d-26261aefd69f None None] MFA Rules not processed for user `3e9e880f6a804116984b21afd1d301cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:14.455682 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-176ea8cf-5551-48a7-831d-26261aefd69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:14.568952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1306/2588] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:14.569886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:14.681389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5007-8712-4b39-848a-fb0e3e8a67fd admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:14.687537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:14.688177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:14.688441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:14.688715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:14.689796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:14.692183 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:15.107205 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1283/2589] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:14 2022] POST /identity/v3/projects => generated 383 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:56:15.108450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea8cf-5551-48a7-831d-26261aefd69f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:15.119997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea8cf-5551-48a7-831d-26261aefd69f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:15.198819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:15.200128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:15.200433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:15.200696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:15.201497 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:15.208093 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:15.218289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:15.315531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1307/2590] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:15 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:15.320007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:15.332811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136211ba-5b23-4193-826c-8cbe8015677e admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:15.340146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:15.340505 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:15.343984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:15.343984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:15.343984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:15.343984 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:15.360123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1284/2591] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:15.365484 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:15.378506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7621-48b8-466f-b1a1-37bceb3d6041 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:15.385794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:15.386473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:15.386757 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:15.387035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] PATH_INFO: `/v3/projects/e6998b89e9ae496e821928471eecce81/users/5a9fa7d4d946454a813bcc5cfb3aa555/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:15.425007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6998b89e9ae496e821928471eecce81, user_id=5a9fa7d4d946454a813bcc5cfb3aa555, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:15.428740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:15.507796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1308/2592] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:15 2022] PUT /identity/v3/projects/e6998b89e9ae496e821928471eecce81/users/5a9fa7d4d946454a813bcc5cfb3aa555/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:15.511738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:15.526339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c784fd8-4680-44ec-bcb6-ff9e2a1df9f5 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:15.617846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca28332-7f66-4a84-9512-eff02d19c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:15.619297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28332-7f66-4a84-9512-eff02d19c3eb admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:15.619844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28332-7f66-4a84-9512-eff02d19c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:15.620602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28332-7f66-4a84-9512-eff02d19c3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:15.621539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca28332-7f66-4a84-9512-eff02d19c3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:15.623809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca28332-7f66-4a84-9512-eff02d19c3eb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:15.652765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1285/2593] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:15.662159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:15.668870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0f41e-eee8-40cc-93fe-80edfc17936a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:15.674569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:15.675388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:15.675948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:15.676097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] PATH_INFO: `/v3/projects/e6998b89e9ae496e821928471eecce81/users/5a9fa7d4d946454a813bcc5cfb3aa555/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:15.678307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6998b89e9ae496e821928471eecce81, user_id=5a9fa7d4d946454a813bcc5cfb3aa555, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:15.681178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:15.698218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1309/2594] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:15 2022] PUT /identity/v3/projects/e6998b89e9ae496e821928471eecce81/users/5a9fa7d4d946454a813bcc5cfb3aa555/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:15.708755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a571-5228-44bb-a626-d44134711162 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:15.708986 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a571-5228-44bb-a626-d44134711162 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:15.709270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9a571-5228-44bb-a626-d44134711162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:15.768006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6ef9a571-5228-44bb-a626-d44134711162 None None] MFA Rules not processed for user `5a9fa7d4d946454a813bcc5cfb3aa555`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:15.769685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6ef9a571-5228-44bb-a626-d44134711162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:15.925534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:15.969053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1286/2595] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:15.975985 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:15.977754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:16.164939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2a9c6-eddc-4ad5-bf88-6e0f84943595 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:16.175025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:16.182423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:16.182423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:16.182423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:16.204377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:16.206524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:16.225466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1310/2596] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:16.381195 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9a571-5228-44bb-a626-d44134711162 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:16.393511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9a571-5228-44bb-a626-d44134711162 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:16.401206 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6350c3-90a4-4a71-8978-e35f70f031a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:16.401818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6350c3-90a4-4a71-8978-e35f70f031a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:16.402097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6350c3-90a4-4a71-8978-e35f70f031a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:16.402370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6350c3-90a4-4a71-8978-e35f70f031a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:16.467166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6350c3-90a4-4a71-8978-e35f70f031a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:16.468641 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6350c3-90a4-4a71-8978-e35f70f031a3 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:16.478460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1287/2597] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:56:17.107138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:17.215605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4f7e6-042e-48a6-b1e4-4062599d063c service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:17.221589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:17.222267 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:17.222716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:17.223008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] PATH_INFO: `/v3/users/3e9e880f6a804116984b21afd1d301cd` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:17.224864 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9e880f6a804116984b21afd1d301cd)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:17.227026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:17.507480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9e880f6a804116984b21afd1d301cd'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:17.509671 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9e880f6a804116984b21afd1d301cd'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:17.521918 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:17.545106 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9e880f6a804116984b21afd1d301cd'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:17.712899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9e880f6a804116984b21afd1d301cd'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:17.713889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9e880f6a804116984b21afd1d301cd'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:17.733739 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1311/2598] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:17 2022] DELETE /identity/v3/users/3e9e880f6a804116984b21afd1d301cd => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:17.739012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:17.739575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:17.739789 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:17.763092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:17.766869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:17.832589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1288/2599] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:17.844552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:17.846596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:17.917339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a76d-8fb7-449f-a447-8e74299728c7 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:17.922600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:17.923227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:17.924198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:17.924476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:17.937164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:17.941079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:17.954199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1312/2600] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:56:18.042637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:18.044509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:18.069623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ec73-fb34-4c68-b651-1187b228e74e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:18.077147 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:18.077960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:18.078341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:18.078819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] PATH_INFO: `/v3/users/0150a12ff77b433496b370fa47f0dbe7` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:18.080134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0150a12ff77b433496b370fa47f0dbe7)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:18.082207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:18.418262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0150a12ff77b433496b370fa47f0dbe7'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:18.418929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0150a12ff77b433496b370fa47f0dbe7'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:18.432429 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0150a12ff77b433496b370fa47f0dbe7'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:18.517504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0150a12ff77b433496b370fa47f0dbe7'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:18.518203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0150a12ff77b433496b370fa47f0dbe7'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:18.534065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1289/2601] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:18 2022] DELETE /identity/v3/users/0150a12ff77b433496b370fa47f0dbe7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:19.170003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:19.182404 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db48f4c-c39c-471c-b4b4-9d05868be6a1 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:19.250393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:19.251007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.251285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.252274 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] PATH_INFO: `/v3/projects/228bfc8aab3f49d2ab2c2a687674410f` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.253420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228bfc8aab3f49d2ab2c2a687674410f)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:19.255637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:19.289809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:19.292572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:19.309407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:19.313343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84d58d-dbe1-45f1-8cc0-ed8476015478 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:19.318832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:19.319577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.325891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.325891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] PATH_INFO: `/v3/projects/613efc2838734a61900298b97c772bb8` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.325891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613efc2838734a61900298b97c772bb8)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:19.325891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:19.363457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228bfc8aab3f49d2ab2c2a687674410f', 'request_id': 'req-d25e7e19-1a03-4231-aadc-868b8af61de5'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.369623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228bfc8aab3f49d2ab2c2a687674410f', 'request_id': 'req-d25e7e19-1a03-4231-aadc-868b8af61de5'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.432564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613efc2838734a61900298b97c772bb8', 'request_id': 'req-0472761f-7ff4-4ab2-8921-65e17942c906'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.438780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613efc2838734a61900298b97c772bb8', 'request_id': 'req-0472761f-7ff4-4ab2-8921-65e17942c906'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.448672 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228bfc8aab3f49d2ab2c2a687674410f', 'request_id': 'req-d25e7e19-1a03-4231-aadc-868b8af61de5'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.459559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] The token cache is being invalidate because project 228bfc8aab3f49d2ab2c2a687674410f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:19.465393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.465393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d25e7e19-1a03-4231-aadc-868b8af61de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.465393 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1313/2602] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:19 2022] DELETE /identity/v3/projects/228bfc8aab3f49d2ab2c2a687674410f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:19.466993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e5aa-36f9-4100-9453-9e4bd2d9fc4b None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.467306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e5aa-36f9-4100-9453-9e4bd2d9fc4b None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.467622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71e5aa-36f9-4100-9453-9e4bd2d9fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.482506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:19.488568 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0f71e5aa-36f9-4100-9453-9e4bd2d9fc4b None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:19.489761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0f71e5aa-36f9-4100-9453-9e4bd2d9fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:19.522602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613efc2838734a61900298b97c772bb8', 'request_id': 'req-0472761f-7ff4-4ab2-8921-65e17942c906'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.533878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] The token cache is being invalidate because project 613efc2838734a61900298b97c772bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:19.534432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.535891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.537636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1290/2603] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:19 2022] DELETE /identity/v3/projects/613efc2838734a61900298b97c772bb8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:19.541489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:19.542919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:19.552156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1314/2604] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:56:19.565064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a940-00eb-4aff-946b-f28747bac213 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.565280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a940-00eb-4aff-946b-f28747bac213 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.565612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a940-00eb-4aff-946b-f28747bac213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.585233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4b12a940-00eb-4aff-946b-f28747bac213 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:19.588518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4b12a940-00eb-4aff-946b-f28747bac213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:19.596770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1315/2605] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:56:19.600852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12a940-00eb-4aff-946b-f28747bac213 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:19.609020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472761f-7ff4-4ab2-8921-65e17942c906 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:19.610222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12a940-00eb-4aff-946b-f28747bac213 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:19.616747 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:19.616978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:19.617391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.617583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.617734 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.617870 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.618010 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] PATH_INFO: `/v3/users/5a9fa7d4d946454a813bcc5cfb3aa555` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.618199 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.618833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:19.619088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9fa7d4d946454a813bcc5cfb3aa555)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:19.619234 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:19.620777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:19.621072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:19.641055 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1316/2606] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:56:19.645505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:19.655152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099d2e-c86b-4f39-995f-572daa9716ef admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:19.661644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:19.662240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.662519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.662787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.663511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:19.665418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:19.747519 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1317/2607] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:19 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:56:19.752119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:19.814294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9fa7d4d946454a813bcc5cfb3aa555'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.814974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9fa7d4d946454a813bcc5cfb3aa555'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.820972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e432dbf-9475-47ab-97d6-085bcac8e82a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:19.825811 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:19.826607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:19.826893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:19.827171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:19.827845 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:19.830289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:19.832096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9fa7d4d946454a813bcc5cfb3aa555'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.916901 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9fa7d4d946454a813bcc5cfb3aa555'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.917565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9fa7d4d946454a813bcc5cfb3aa555'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:19.936957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1291/2608] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:19 2022] DELETE /identity/v3/users/5a9fa7d4d946454a813bcc5cfb3aa555 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:19.946867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1318/2609] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:19 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:56:19.950840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:19.952397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:19.963962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:20.024716 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900aac91-5bdf-4567-8aee-f249886cb052 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:20.031081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:20.034376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.035676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.036167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:20.037590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:20.038710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:20.050008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1292/2610] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:20.054033 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:20.068160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af1ace-8c6a-4238-8795-96624dc85fd8 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:20.074133 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c4e40-292c-45ad-b3b7-fd82ad94ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:20.074680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4e40-292c-45ad-b3b7-fd82ad94ad0b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.075825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4e40-292c-45ad-b3b7-fd82ad94ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.075825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4e40-292c-45ad-b3b7-fd82ad94ad0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:20.080680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c4e40-292c-45ad-b3b7-fd82ad94ad0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:20.080680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c4e40-292c-45ad-b3b7-fd82ad94ad0b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:20.097447 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1319/2611] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:20.102036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:20.112457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4582a-dda1-4903-859c-aa911de78b59 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:20.117062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:20.118117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.118117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.118318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] PATH_INFO: `/v3/projects/527adda46aaa4a52a9e8ef3123dd8a4a/users/2c9c7bb6588e42d683e46bed77ba6e4e/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:20.135388 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=527adda46aaa4a52a9e8ef3123dd8a4a, user_id=2c9c7bb6588e42d683e46bed77ba6e4e, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:20.139697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:20.217265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1293/2612] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:20 2022] PUT /identity/v3/projects/527adda46aaa4a52a9e8ef3123dd8a4a/users/2c9c7bb6588e42d683e46bed77ba6e4e/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:20.229541 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.230031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.230143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:20.269137 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] MFA Rules not processed for user `2c9c7bb6588e42d683e46bed77ba6e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:20.270355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:20.305219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:20.344228 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1320/2613] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:20.488766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:20.491690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:20.569477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5230a6-42a4-4a79-ac1a-fd309bc52e8b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:20.574998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa1847-06dc-45b2-be32-622f1048f1ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:20.575657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa1847-06dc-45b2-be32-622f1048f1ba service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.575936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa1847-06dc-45b2-be32-622f1048f1ba service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.576210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa1847-06dc-45b2-be32-622f1048f1ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:20.586950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa1847-06dc-45b2-be32-622f1048f1ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:20.587588 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:20.588812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa1847-06dc-45b2-be32-622f1048f1ba service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:20.593898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:20.599139 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1294/2614] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:20.669230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fa6b2-7e3e-4725-aa7f-95e0377e8af2 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:20.674498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:20.675136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.675437 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.675710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] PATH_INFO: `/v3/projects/e6998b89e9ae496e821928471eecce81` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:20.676880 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6998b89e9ae496e821928471eecce81)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:20.678830 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:20.797771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6998b89e9ae496e821928471eecce81', 'request_id': 'req-369ab55d-a491-47f3-89d6-5bd10af9f5f7'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:20.804002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6998b89e9ae496e821928471eecce81', 'request_id': 'req-369ab55d-a491-47f3-89d6-5bd10af9f5f7'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:20.865444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6998b89e9ae496e821928471eecce81', 'request_id': 'req-369ab55d-a491-47f3-89d6-5bd10af9f5f7'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:20.879987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] The token cache is being invalidate because project e6998b89e9ae496e821928471eecce81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:20.880592 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:20.881231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-369ab55d-a491-47f3-89d6-5bd10af9f5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:20.882734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1321/2615] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:20 2022] DELETE /identity/v3/projects/e6998b89e9ae496e821928471eecce81 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:20.887656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895665f3-edff-4ddc-9c2f-b433a015530a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.887967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895665f3-edff-4ddc-9c2f-b433a015530a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.888288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895665f3-edff-4ddc-9c2f-b433a015530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:20.909559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-895665f3-edff-4ddc-9c2f-b433a015530a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:20.911497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-895665f3-edff-4ddc-9c2f-b433a015530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:20.972501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1295/2616] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:20.980211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c9c01-2751-4a68-985b-c22c18730843 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:20.980504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c9c01-2751-4a68-985b-c22c18730843 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:20.980786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c9c01-2751-4a68-985b-c22c18730843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.000467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-9f3c9c01-2751-4a68-985b-c22c18730843 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:21.002167 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9f3c9c01-2751-4a68-985b-c22c18730843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:21.010097 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1322/2617] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:21.014365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895665f3-edff-4ddc-9c2f-b433a015530a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:21.021011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:21.024710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895665f3-edff-4ddc-9c2f-b433a015530a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:21.029308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:21.029868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.034672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.034672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.034672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:21.034672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:21.034672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:21.044250 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1296/2618] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:56:21.048695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c9c01-2751-4a68-985b-c22c18730843 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:21.057833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c9c01-2751-4a68-985b-c22c18730843 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:21.062407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:21.062997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.063318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.063623 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.064800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:21.066676 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:21.164380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1323/2619] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:21 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:21.168579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:21.178985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13dd4-99f1-4162-b90b-df7dbef3352f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:21.239179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:21.239835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.240113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.240387 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.241255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:21.243000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:21.328938 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1297/2620] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:21 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:21.333242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:21.345444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c745e-1a96-407e-9e60-902a6ee82d71 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:21.350565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:21.351218 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.351561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.351839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.352489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:21.354066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:21.365075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1324/2621] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:56:21.369240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:21.384186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4001bc-4131-4c95-a0df-ffb69cd90b4f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:21.385389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbe465-3801-41a1-a885-f95c9852fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:21.386009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe465-3801-41a1-a885-f95c9852fbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.386292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe465-3801-41a1-a885-f95c9852fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.387044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe465-3801-41a1-a885-f95c9852fbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.387200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbe465-3801-41a1-a885-f95c9852fbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:21.388884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbe465-3801-41a1-a885-f95c9852fbb1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:21.400004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1298/2622] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:21.404385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:21.417152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53ef6-f770-4f4f-beb7-3093027f3e31 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:21.424637 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:21.425826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.426330 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.426606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] PATH_INFO: `/v3/projects/b808adf33b2c425b8182a954e830739d/users/a97f6ab23ba1430092115dd7f2f3ff0b/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.447143 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b808adf33b2c425b8182a954e830739d, user_id=a97f6ab23ba1430092115dd7f2f3ff0b, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:21.450735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:21.570406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:21.584166 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1325/2623] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:21 2022] PUT /identity/v3/projects/b808adf33b2c425b8182a954e830739d/users/a97f6ab23ba1430092115dd7f2f3ff0b/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:21.649366 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90c31f-142a-4129-ba24-a9ff6944f48e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.649874 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90c31f-142a-4129-ba24-a9ff6944f48e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.649964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90c31f-142a-4129-ba24-a9ff6944f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.679844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-1b90c31f-142a-4129-ba24-a9ff6944f48e None None] MFA Rules not processed for user `a97f6ab23ba1430092115dd7f2f3ff0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:21.681060 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-1b90c31f-142a-4129-ba24-a9ff6944f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:21.771776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1299/2624] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:21.791888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:21.793839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:21.860310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064396f-a168-4e57-aa89-406c88d197bc admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:21.865959 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b337a4-77f5-47cd-9f97-e62f088502fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:21.866609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b337a4-77f5-47cd-9f97-e62f088502fa service glance] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:21.866899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b337a4-77f5-47cd-9f97-e62f088502fa service glance] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:21.867208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b337a4-77f5-47cd-9f97-e62f088502fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:21.876168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b337a4-77f5-47cd-9f97-e62f088502fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:21.877768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b337a4-77f5-47cd-9f97-e62f088502fa service glance] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:21.886842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1326/2625] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:25.422264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903afa-192f-4eb8-8c7a-2282626ba818 None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:25.422831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903afa-192f-4eb8-8c7a-2282626ba818 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:25.422932 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903afa-192f-4eb8-8c7a-2282626ba818 None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:25.424869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1300/2626] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:56:25.431340 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775456-66df-4bf2-9df3-cd055279adb9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:25.431848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775456-66df-4bf2-9df3-cd055279adb9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:25.431951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775456-66df-4bf2-9df3-cd055279adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:25.453089 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-12775456-66df-4bf2-9df3-cd055279adb9 None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:25.454306 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-12775456-66df-4bf2-9df3-cd055279adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:25.556808 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1327/2627] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:56:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:25.570267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903afa-192f-4eb8-8c7a-2282626ba818 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:25.588327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903afa-192f-4eb8-8c7a-2282626ba818 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:25.593597 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399778b9-9c16-4bf5-b1e8-26dfcc13cd3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:25.594568 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399778b9-9c16-4bf5-b1e8-26dfcc13cd3b service glance] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:25.595482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399778b9-9c16-4bf5-b1e8-26dfcc13cd3b service glance] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:25.597079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399778b9-9c16-4bf5-b1e8-26dfcc13cd3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:25.608488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399778b9-9c16-4bf5-b1e8-26dfcc13cd3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:25.610092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399778b9-9c16-4bf5-b1e8-26dfcc13cd3b service glance] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:25.623066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1301/2628] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:25.840920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006cd4-5efa-417f-bdac-e71005c85493 None None] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:25.841210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006cd4-5efa-417f-bdac-e71005c85493 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:25.841463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006cd4-5efa-417f-bdac-e71005c85493 None None] PATH_INFO: `/` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:25.842857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1328/2629] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 28 08:56:25.849481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e834a-4414-44d2-9a99-2415be0ab9c8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:25.849773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e834a-4414-44d2-9a99-2415be0ab9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:25.850048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e834a-4414-44d2-9a99-2415be0ab9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:25.874769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-bb1e834a-4414-44d2-9a99-2415be0ab9c8 None None] MFA Rules not processed for user `5523644021bf4d91a3a9246bee763b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:25.877248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bb1e834a-4414-44d2-9a99-2415be0ab9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:25.926941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:25.936633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1302/2630] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:56:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:25.962210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5006cd4-5efa-417f-bdac-e71005c85493 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:25.964529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b5006cd4-5efa-417f-bdac-e71005c85493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:25.985967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5006cd4-5efa-417f-bdac-e71005c85493 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:25.990237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78686988-05e0-48f3-b88a-244fe2202107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:25.990881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686988-05e0-48f3-b88a-244fe2202107 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:25.991161 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686988-05e0-48f3-b88a-244fe2202107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:25.991450 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78686988-05e0-48f3-b88a-244fe2202107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:26.000149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686988-05e0-48f3-b88a-244fe2202107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:26.001630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78686988-05e0-48f3-b88a-244fe2202107 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:26.023173 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1329/2631] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:26.097941 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e69ad-2d04-4be4-ac77-ab0b0cecf11b None None] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:26.098352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e69ad-2d04-4be4-ac77-ab0b0cecf11b None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:26.098627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e69ad-2d04-4be4-ac77-ab0b0cecf11b None None] PATH_INFO: `/` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:26.100013 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1303/2632] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 28 08:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 28 08:56:26.105442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:26.105726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:26.106019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:26.127110 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] MFA Rules not processed for user `0969ec55ae1244c09694079a72bf8310`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:26.128329 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:26.137564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1330/2633] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 28 08:56:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:26.151189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e69ad-2d04-4be4-ac77-ab0b0cecf11b None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:26.163376 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e69ad-2d04-4be4-ac77-ab0b0cecf11b None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:26.167502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ab5a9-7b02-4a98-94f8-634f14a95c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:26.168107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab5a9-7b02-4a98-94f8-634f14a95c22 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:26.168389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab5a9-7b02-4a98-94f8-634f14a95c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:26.168697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ab5a9-7b02-4a98-94f8-634f14a95c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:26.179563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ab5a9-7b02-4a98-94f8-634f14a95c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:26.181012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ab5a9-7b02-4a98-94f8-634f14a95c22 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:26.192430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1304/2634] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:26.956026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:26.956026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:27.024558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651405a6-e354-4f91-b3f5-16eaedbd0baa None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:27.029343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:27.029980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:27.030255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:27.030555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] PATH_INFO: `/v3/users/2c9c7bb6588e42d683e46bed77ba6e4e` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:27.031748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9c7bb6588e42d683e46bed77ba6e4e)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:27.034381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:27.052433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:27.223666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9c7bb6588e42d683e46bed77ba6e4e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:27.224376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9c7bb6588e42d683e46bed77ba6e4e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:27.237862 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9c7bb6588e42d683e46bed77ba6e4e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:27.300011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9c7bb6588e42d683e46bed77ba6e4e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:27.300790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9c7bb6588e42d683e46bed77ba6e4e'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:27.316108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1331/2635] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:26 2022] DELETE /identity/v3/users/2c9c7bb6588e42d683e46bed77ba6e4e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:27.320709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:27.321438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:27.321438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:27.342170 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:27.348281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:27.417433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1305/2636] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:56:27.427646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:27.429104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:27.487694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054683b-9f86-4b02-8596-80138c0b7562 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:27.491942 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c5c7-db59-4889-a71d-a0fa76db42c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:27.492551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c5c7-db59-4889-a71d-a0fa76db42c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:27.492832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c5c7-db59-4889-a71d-a0fa76db42c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:27.493103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c5c7-db59-4889-a71d-a0fa76db42c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:27.503332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478c5c7-db59-4889-a71d-a0fa76db42c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:27.504840 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478c5c7-db59-4889-a71d-a0fa76db42c3 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:27.514172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1332/2637] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:28.034674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:28.036439 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:28.049396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7c9ca-9f52-4f08-8af8-932a329bcc73 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:28.055209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:28.059968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.059968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.059968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] PATH_INFO: `/v3/projects/527adda46aaa4a52a9e8ef3123dd8a4a` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.059968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527adda46aaa4a52a9e8ef3123dd8a4a)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:28.060589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:28.164384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527adda46aaa4a52a9e8ef3123dd8a4a', 'request_id': 'req-d28813e4-13b0-4a5d-a15e-f901d0da5661'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:28.171157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527adda46aaa4a52a9e8ef3123dd8a4a', 'request_id': 'req-d28813e4-13b0-4a5d-a15e-f901d0da5661'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:28.231547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527adda46aaa4a52a9e8ef3123dd8a4a', 'request_id': 'req-d28813e4-13b0-4a5d-a15e-f901d0da5661'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:28.242707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] The token cache is being invalidate because project 527adda46aaa4a52a9e8ef3123dd8a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:28.242993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:28.243635 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d28813e4-13b0-4a5d-a15e-f901d0da5661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:28.245230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1306/2638] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:28 2022] DELETE /identity/v3/projects/527adda46aaa4a52a9e8ef3123dd8a4a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:28.250172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b475a-95c5-4be7-ba95-3e6dc9256622 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.250606 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b475a-95c5-4be7-ba95-3e6dc9256622 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.250943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b475a-95c5-4be7-ba95-3e6dc9256622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.272235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-040b475a-95c5-4be7-ba95-3e6dc9256622 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:28.273421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-040b475a-95c5-4be7-ba95-3e6dc9256622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:28.337349 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1333/2639] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:56:28.345123 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff61e-2805-441f-8e22-fe15257e3858 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.346409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff61e-2805-441f-8e22-fe15257e3858 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.346409 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff61e-2805-441f-8e22-fe15257e3858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.367393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-475ff61e-2805-441f-8e22-fe15257e3858 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:28.368656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-475ff61e-2805-441f-8e22-fe15257e3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:28.376657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1307/2640] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:28.381825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b475a-95c5-4be7-ba95-3e6dc9256622 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:28.392216 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b475a-95c5-4be7-ba95-3e6dc9256622 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:28.398478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:28.399099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.399379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.399693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.400354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:28.400653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:28.402255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:28.416168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1334/2641] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:56:28.420646 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff61e-2805-441f-8e22-fe15257e3858 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:28.430219 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff61e-2805-441f-8e22-fe15257e3858 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:28.434930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:28.435566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.435852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.436127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.436769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:28.438660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:28.547768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1308/2642] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:28 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:28.552066 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:28.562446 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b3b8-81eb-4671-9c0e-afb20e2b1fc2 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:28.585801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:28.624112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:28.624702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.624982 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.625255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.625893 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:28.628604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:28.717367 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1335/2643] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:28 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:28.721786 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:28.732306 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54416dc-cf54-41c1-9fa9-c24c9a874597 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:28.740411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:28.741204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.741594 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.742035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.742943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:28.745253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:28.756522 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1309/2644] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:28.761077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:28.772403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f802-e5a2-4d20-a43e-abdfcc475cef admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:28.777711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca4fbd-0664-4585-9df1-ff52d5b07545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:28.778310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4fbd-0664-4585-9df1-ff52d5b07545 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.778587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4fbd-0664-4585-9df1-ff52d5b07545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.778856 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4fbd-0664-4585-9df1-ff52d5b07545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.779702 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4fbd-0664-4585-9df1-ff52d5b07545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:28.781292 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4fbd-0664-4585-9df1-ff52d5b07545 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:28.797472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1336/2645] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:28.802391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:28.816032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c028e-fdb9-4df8-bc0f-c8e461d7fbc1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:28.822895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:28.823707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.825703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.835844 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] PATH_INFO: `/v3/projects/5f3338b425e84e3dbf34abb51cfa32dc/users/55537ff0175c426385e8f2c35958ff20/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.851674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3338b425e84e3dbf34abb51cfa32dc, user_id=55537ff0175c426385e8f2c35958ff20, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:28.854575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:28.920688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1310/2646] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:28 2022] PUT /identity/v3/projects/5f3338b425e84e3dbf34abb51cfa32dc/users/55537ff0175c426385e8f2c35958ff20/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:28.931357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:28.931674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:28.939120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:28.982451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] MFA Rules not processed for user `55537ff0175c426385e8f2c35958ff20`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:28.983851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:29.085305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1337/2647] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:29.089922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.096485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:29.243837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.245271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:29.250973 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce54df-99ff-451b-96be-3b5b66b99cc6 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:29.256285 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:29.256990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.257370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.257712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.258425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:29.260462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:29.308433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93dc13-a5f8-451a-94ad-ce2d8e4c248f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:29.312195 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:29.312736 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.313015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.313287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.315206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:29.324246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1311/2648] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:29 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:29.328983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.366699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:29.386828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:29.388290 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:29.398515 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1338/2649] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:56:29.398691 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af346c7-79c6-43e6-bdc6-5d8ef3afcdd7 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:29.404265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:29.404881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.405292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.405572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.406336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:29.410083 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:29.517338 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1312/2650] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:29 2022] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:56:29.521509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.531983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2b4d5-493c-4a44-b913-059fc449dc84 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:29.537246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:29.537831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.538487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.538487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.539015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:29.540648 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:29.555042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1339/2651] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:29.557796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.568904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8f9bc-34c5-4f78-952b-0bdc985958cf admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:29.574046 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:29.580492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.580492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.580492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] PATH_INFO: `/v3/projects/63bdf93fe8ba4dd0bc35119085e36538/users/d9d546ee3878429fad7a86b623d1720d/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.592614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bdf93fe8ba4dd0bc35119085e36538, user_id=d9d546ee3878429fad7a86b623d1720d, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:29.595308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:29.666065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1313/2652] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:29 2022] PUT /identity/v3/projects/63bdf93fe8ba4dd0bc35119085e36538/users/d9d546ee3878429fad7a86b623d1720d/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:29.670160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.683139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34772984-cc47-419d-affa-f28f346f03ff admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:29.756874 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af7dba-e34e-4a62-9376-b8e2e6564000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:29.757653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af7dba-e34e-4a62-9376-b8e2e6564000 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.758022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af7dba-e34e-4a62-9376-b8e2e6564000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.758299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af7dba-e34e-4a62-9376-b8e2e6564000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.758949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af7dba-e34e-4a62-9376-b8e2e6564000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:29.760956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af7dba-e34e-4a62-9376-b8e2e6564000 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:29.773075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1340/2653] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:29.777092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.788146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628fcae-5320-4135-b90b-47f3a47a5fc2 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:29.793174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaee58-6f3e-47cc-9417-79e5f5643138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:29.793790 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaee58-6f3e-47cc-9417-79e5f5643138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.794070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaee58-6f3e-47cc-9417-79e5f5643138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.794348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaee58-6f3e-47cc-9417-79e5f5643138 admin admin] PATH_INFO: `/v3/projects/63bdf93fe8ba4dd0bc35119085e36538/users/d9d546ee3878429fad7a86b623d1720d/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.796354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabaee58-6f3e-47cc-9417-79e5f5643138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bdf93fe8ba4dd0bc35119085e36538, user_id=d9d546ee3878429fad7a86b623d1720d, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:29.799084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabaee58-6f3e-47cc-9417-79e5f5643138 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:29.809534 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1314/2654] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:29 2022] PUT /identity/v3/projects/63bdf93fe8ba4dd0bc35119085e36538/users/d9d546ee3878429fad7a86b623d1720d/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:29.821600 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.821791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.822064 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.853977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] MFA Rules not processed for user `d9d546ee3878429fad7a86b623d1720d`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:29.855297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:29.969744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1341/2655] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:29.996819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:29.996819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:29.996819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:29.997123 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:29.998250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:30.007945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:30.009475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:30.049293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:30.063957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4614b0-2715-4875-a800-960df0357e8a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:30.068785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:30.069395 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:30.069701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:30.069975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:30.075073 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1315/2656] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:30.077210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:30.079809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:30.081940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:30.090565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:30.092080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:30.093817 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1342/2657] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:29 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:30.168606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b2ab1-f373-4304-97a8-cb38cc677245 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:30.179458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064ca79-2a33-4f7e-9f9f-607ae8568d0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:30.179977 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064ca79-2a33-4f7e-9f9f-607ae8568d0f service swift] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:30.180265 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064ca79-2a33-4f7e-9f9f-607ae8568d0f service swift] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:30.180541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064ca79-2a33-4f7e-9f9f-607ae8568d0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:30.189965 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064ca79-2a33-4f7e-9f9f-607ae8568d0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:30.191621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064ca79-2a33-4f7e-9f9f-607ae8568d0f service swift] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:30.200572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1316/2658] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:56:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 08:56:30.253832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:30.344975 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeffbe-a07a-44a2-90bc-cf06f8b15546 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:30.352701 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:30.353700 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:30.354046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:30.354526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] PATH_INFO: `/v3/users/55537ff0175c426385e8f2c35958ff20` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:30.356002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=55537ff0175c426385e8f2c35958ff20)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:30.358132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:30.661854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55537ff0175c426385e8f2c35958ff20'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:30.662804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55537ff0175c426385e8f2c35958ff20'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:30.708626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55537ff0175c426385e8f2c35958ff20'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:30.760545 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55537ff0175c426385e8f2c35958ff20'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:30.761327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55537ff0175c426385e8f2c35958ff20'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:30.781987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1343/2659] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:30 2022] DELETE /identity/v3/users/55537ff0175c426385e8f2c35958ff20 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:30.786827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:30.787374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:30.787634 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:30.831858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:30.833167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:30.951299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1317/2660] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:30.959124 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:30.961284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:31.136831 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820c53-ed91-44d3-aed7-bc58a22ce4fd admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:31.140804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:31.141530 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:31.141981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:31.142270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:31.163586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:31.165688 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:31.185344 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1344/2661] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:56:31.910785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:31.913596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:31.938382 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f249e-5c66-4ca2-8af1-d51f713ee2b2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:31.947348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:31.954772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:31.954772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:31.954772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] PATH_INFO: `/v3/projects/5f3338b425e84e3dbf34abb51cfa32dc` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:31.954772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3338b425e84e3dbf34abb51cfa32dc)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:31.954772 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:32.099393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3338b425e84e3dbf34abb51cfa32dc', 'request_id': 'req-62ffb533-0465-4db0-8e4c-fd870516d755'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.112096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3338b425e84e3dbf34abb51cfa32dc', 'request_id': 'req-62ffb533-0465-4db0-8e4c-fd870516d755'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.180112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3338b425e84e3dbf34abb51cfa32dc', 'request_id': 'req-62ffb533-0465-4db0-8e4c-fd870516d755'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.192413 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:32.201470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] The token cache is being invalidate because project 5f3338b425e84e3dbf34abb51cfa32dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:32.201865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.204451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.207248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1318/2662] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:31 2022] DELETE /identity/v3/projects/5f3338b425e84e3dbf34abb51cfa32dc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:32.211238 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:32.228984 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6043a-01d0-4c6a-84b4-a80e8ecf710d service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:32.250915 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:32.342524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:32.344032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:32.344311 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:32.344762 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] PATH_INFO: `/v3/users/d9d546ee3878429fad7a86b623d1720d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:32.346585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d546ee3878429fad7a86b623d1720d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:32.349724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:32.639707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d546ee3878429fad7a86b623d1720d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.640755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d546ee3878429fad7a86b623d1720d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.671401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d546ee3878429fad7a86b623d1720d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.740824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d546ee3878429fad7a86b623d1720d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.741631 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-38a8d04a-09d4-4ca1-b13f-0d5853b5321a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d546ee3878429fad7a86b623d1720d'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:32.759318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1345/2663] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:32 2022] DELETE /identity/v3/users/d9d546ee3878429fad7a86b623d1720d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:33.304294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:33.304294 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:33.321059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb533-0465-4db0-8e4c-fd870516d755 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:33.494652 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:33.495520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:33.496106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:33.496248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] PATH_INFO: `/v3/projects/63bdf93fe8ba4dd0bc35119085e36538` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:33.497954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=63bdf93fe8ba4dd0bc35119085e36538)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:33.500340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:33.688288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63bdf93fe8ba4dd0bc35119085e36538', 'request_id': 'req-97bd7a43-5947-4d67-a82b-be86314f36bd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:33.701888 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63bdf93fe8ba4dd0bc35119085e36538', 'request_id': 'req-97bd7a43-5947-4d67-a82b-be86314f36bd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:33.819799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63bdf93fe8ba4dd0bc35119085e36538', 'request_id': 'req-97bd7a43-5947-4d67-a82b-be86314f36bd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:33.844962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] The token cache is being invalidate because project 63bdf93fe8ba4dd0bc35119085e36538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:33.844962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:33.844962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-97bd7a43-5947-4d67-a82b-be86314f36bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:33.844962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1319/2664] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:33 2022] DELETE /identity/v3/projects/63bdf93fe8ba4dd0bc35119085e36538 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:33.850230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da34d2-4258-46c3-9cea-30230cca58e8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:33.850734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da34d2-4258-46c3-9cea-30230cca58e8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:33.850963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da34d2-4258-46c3-9cea-30230cca58e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:33.876961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-06da34d2-4258-46c3-9cea-30230cca58e8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:33.878626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-06da34d2-4258-46c3-9cea-30230cca58e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:33.976413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1346/2665] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:33.978630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd746-7c9f-48e3-abc2-f9f54165a949 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:33.979003 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd746-7c9f-48e3-abc2-f9f54165a949 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:33.979176 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cd746-7c9f-48e3-abc2-f9f54165a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.013718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-092cd746-7c9f-48e3-abc2-f9f54165a949 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:34.015411 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-092cd746-7c9f-48e3-abc2-f9f54165a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:34.025919 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1320/2666] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:34.030277 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da34d2-4258-46c3-9cea-30230cca58e8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.041517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da34d2-4258-46c3-9cea-30230cca58e8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:34.051723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:34.053770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.054722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.055619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.057103 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:34.057633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:34.059270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:34.073726 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1347/2667] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:56:34.078496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd746-7c9f-48e3-abc2-f9f54165a949 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.089547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cd746-7c9f-48e3-abc2-f9f54165a949 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:34.100244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:34.101198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.101556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.101701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.102361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:34.104363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:34.201372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1321/2668] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:34 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:34.206318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.217005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc56f9e-efe4-4956-8b98-0e3e471accfb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:34.251042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:34.325170 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:34.325957 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.326318 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.326504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.327179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:34.329186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:34.399209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1348/2669] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:34 2022] POST /identity/v3/users => generated 279 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:34.405104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.415811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8b78-fb84-45ee-b24d-a03e0ae0a324 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:34.420657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:34.421379 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.421658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.422015 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.422829 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:34.428244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:34.437899 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1322/2670] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:34.442716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.455257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52a1e-0ffb-4899-8a57-10fcc046794f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:34.460422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbffe0-31a6-4f82-bd28-7666df5aaed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:34.461205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbffe0-31a6-4f82-bd28-7666df5aaed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.461652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbffe0-31a6-4f82-bd28-7666df5aaed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.462348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbffe0-31a6-4f82-bd28-7666df5aaed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.463002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbffe0-31a6-4f82-bd28-7666df5aaed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:34.464730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbffe0-31a6-4f82-bd28-7666df5aaed3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:34.480940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1349/2671] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:34.482761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.495467 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480be03-acf5-44a5-a572-5991381be7fe admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:34.501131 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:34.502092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.502269 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.502551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] PATH_INFO: `/v3/projects/12ecfd9cb0994b48ae581dde88687b51/users/f2d09e31f5a041cf985798a23dee2756/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.521686 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ecfd9cb0994b48ae581dde88687b51, user_id=f2d09e31f5a041cf985798a23dee2756, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:34.524852 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:34.592402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1323/2672] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:34 2022] PUT /identity/v3/projects/12ecfd9cb0994b48ae581dde88687b51/users/f2d09e31f5a041cf985798a23dee2756/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:34.603556 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf7f59-7407-4a91-87aa-3d3f4063b434 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.603794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf7f59-7407-4a91-87aa-3d3f4063b434 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.604138 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf7f59-7407-4a91-87aa-3d3f4063b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.650778 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-01bf7f59-7407-4a91-87aa-3d3f4063b434 None None] MFA Rules not processed for user `f2d09e31f5a041cf985798a23dee2756`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:34.652038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-01bf7f59-7407-4a91-87aa-3d3f4063b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:34.756965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1350/2673] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:34.761378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.798326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:34.843332 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494417d9-f097-4074-852b-2c3452179f13 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:34.848526 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:34.849180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:34.849462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:34.849739 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:34.850392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:34.852323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:34.952735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1324/2674] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:34 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:34.956983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf7f59-7407-4a91-87aa-3d3f4063b434 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:34.969652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf7f59-7407-4a91-87aa-3d3f4063b434 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:35.041378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:35.041998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.042258 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.042528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:35.043164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:35.045140 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:35.135962 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1351/2675] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:34 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:56:35.140454 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:35.152609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00bed-10b8-4483-8d45-344e21c813fd admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:35.157290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:35.158421 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.158715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.158983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:35.159675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:35.161267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:35.176166 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1325/2676] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:35.181050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:35.191473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2e7bb-5b5a-4d55-bc11-92074f04b86f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:35.196655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:35.197204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.197480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.197744 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] PATH_INFO: `/v3/projects/8d12aade8cc0484ba2a8d00c09d2d9dd/users/febd880eea0b4a77a19293c548993a54/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:35.214460 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d12aade8cc0484ba2a8d00c09d2d9dd, user_id=febd880eea0b4a77a19293c548993a54, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:35.217204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:35.282783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:35.289550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1352/2677] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:35 2022] PUT /identity/v3/projects/8d12aade8cc0484ba2a8d00c09d2d9dd/users/febd880eea0b4a77a19293c548993a54/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:35.293623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:35.304663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967ce2b-48b6-4cbe-a537-b42dd82e0030 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:35.365928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8abe1-412c-4e58-a19d-316d27e47c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:35.366626 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8abe1-412c-4e58-a19d-316d27e47c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.367025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8abe1-412c-4e58-a19d-316d27e47c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.367326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8abe1-412c-4e58-a19d-316d27e47c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:35.368000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8abe1-412c-4e58-a19d-316d27e47c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:35.369581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8abe1-412c-4e58-a19d-316d27e47c21 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:35.379696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1326/2678] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:35.383858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:35.395832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15fb11-a574-4394-9543-e7fa71ded6cb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:35.400552 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:35.401358 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.401794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.402062 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] PATH_INFO: `/v3/projects/8d12aade8cc0484ba2a8d00c09d2d9dd/users/febd880eea0b4a77a19293c548993a54/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:35.404057 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d12aade8cc0484ba2a8d00c09d2d9dd, user_id=febd880eea0b4a77a19293c548993a54, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:35.406695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:35.429826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1353/2679] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:35 2022] PUT /identity/v3/projects/8d12aade8cc0484ba2a8d00c09d2d9dd/users/febd880eea0b4a77a19293c548993a54/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:35.441887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4d96-b771-4739-af6f-04902d2fa7a8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.445339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4d96-b771-4739-af6f-04902d2fa7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.445339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4d96-b771-4739-af6f-04902d2fa7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:35.471555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-401b4d96-b771-4739-af6f-04902d2fa7a8 None None] MFA Rules not processed for user `febd880eea0b4a77a19293c548993a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:35.472765 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-401b4d96-b771-4739-af6f-04902d2fa7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:35.554913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1327/2680] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:35.567723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:35.570298 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:35.638456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d5451-8839-4c45-a49f-93c0458cc02c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:35.643877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:35.644585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.644873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.645139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:35.657098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:35.659609 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:35.672483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1354/2681] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:35.957103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4d96-b771-4739-af6f-04902d2fa7a8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:35.974707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4d96-b771-4739-af6f-04902d2fa7a8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:35.982358 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac7f8e-018a-4bb4-b153-43e2a02bb065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:35.982979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac7f8e-018a-4bb4-b153-43e2a02bb065 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:35.983258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac7f8e-018a-4bb4-b153-43e2a02bb065 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:35.983554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac7f8e-018a-4bb4-b153-43e2a02bb065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:36.023241 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:36.071120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac7f8e-018a-4bb4-b153-43e2a02bb065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:36.072720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac7f8e-018a-4bb4-b153-43e2a02bb065 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:36.082868 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1328/2682] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:38.536451 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:38.537939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:38.610741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a92d6f-e7b2-4c66-9e02-daeec11c07a7 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:38.616408 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:38.618666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:38.618666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:38.618666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] PATH_INFO: `/v3/users/a97f6ab23ba1430092115dd7f2f3ff0b` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:38.619670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97f6ab23ba1430092115dd7f2f3ff0b)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:38.621899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:38.805058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97f6ab23ba1430092115dd7f2f3ff0b'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:38.805666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97f6ab23ba1430092115dd7f2f3ff0b'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:38.818909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97f6ab23ba1430092115dd7f2f3ff0b'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:38.876638 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97f6ab23ba1430092115dd7f2f3ff0b'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:38.877964 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97f6ab23ba1430092115dd7f2f3ff0b'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:38.891215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1355/2683] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:38 2022] DELETE /identity/v3/users/a97f6ab23ba1430092115dd7f2f3ff0b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:38.896229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:38.896903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:38.897187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:38.917814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:38.919023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:38.980091 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1329/2684] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:38.990909 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:38.995014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:39.002112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:39.048285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851f828-1bdc-4b4c-a125-6bd80185d40e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:39.052563 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dcd7a-7e18-4067-b770-18284061485e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:39.053152 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dcd7a-7e18-4067-b770-18284061485e service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:39.053428 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dcd7a-7e18-4067-b770-18284061485e service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:39.053698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dcd7a-7e18-4067-b770-18284061485e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:39.062729 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dcd7a-7e18-4067-b770-18284061485e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:39.064115 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dcd7a-7e18-4067-b770-18284061485e service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:39.073304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1356/2685] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:39.539400 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:39.540342 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:39.555005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cde744-0144-44bf-8af7-56c48e766908 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:39.561805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:39.562657 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:39.563071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:39.563357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] PATH_INFO: `/v3/projects/b808adf33b2c425b8182a954e830739d` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:39.564699 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b808adf33b2c425b8182a954e830739d)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:39.566742 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:39.734057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b808adf33b2c425b8182a954e830739d', 'request_id': 'req-6ae6d829-f38a-42a7-876f-a6efdb999a1f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:39.740432 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b808adf33b2c425b8182a954e830739d', 'request_id': 'req-6ae6d829-f38a-42a7-876f-a6efdb999a1f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:39.835779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b808adf33b2c425b8182a954e830739d', 'request_id': 'req-6ae6d829-f38a-42a7-876f-a6efdb999a1f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:39.848565 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] The token cache is being invalidate because project b808adf33b2c425b8182a954e830739d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:39.848793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:39.849473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-6ae6d829-f38a-42a7-876f-a6efdb999a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:39.850987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1330/2686] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:39 2022] DELETE /identity/v3/projects/b808adf33b2c425b8182a954e830739d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:39.856008 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f775b-bb1e-418c-9bdc-0f949340b343 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:39.856468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f775b-bb1e-418c-9bdc-0f949340b343 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:39.856581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f775b-bb1e-418c-9bdc-0f949340b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:39.878049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-475f775b-bb1e-418c-9bdc-0f949340b343 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:39.879276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-475f775b-bb1e-418c-9bdc-0f949340b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:39.941074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1357/2687] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:39.948692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7705f9a-917d-4976-b727-20d7ce39ea04 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:39.949188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7705f9a-917d-4976-b727-20d7ce39ea04 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:39.949297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7705f9a-917d-4976-b727-20d7ce39ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:39.971990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f7705f9a-917d-4976-b727-20d7ce39ea04 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:39.973447 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f7705f9a-917d-4976-b727-20d7ce39ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:39.981866 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1331/2688] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:39.987002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f775b-bb1e-418c-9bdc-0f949340b343 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:39.997268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f775b-bb1e-418c-9bdc-0f949340b343 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:40.001977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:40.002754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.003031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.003303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.004169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:40.004467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:40.006153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:40.019934 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1358/2689] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:56:40.022914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7705f9a-917d-4976-b727-20d7ce39ea04 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:40.032349 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7705f9a-917d-4976-b727-20d7ce39ea04 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:40.038055 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:40.049322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.049322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.049322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.049322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:40.049322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:40.192581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1332/2690] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:40 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:40.196540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:40.207641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3dea-c6df-4110-8cff-2379ceb2e2ec admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:40.271251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:40.271965 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.272319 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.272656 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.273641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:40.275696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:40.408090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1359/2691] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:40 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:40.412430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:40.422578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b53d6-df1c-41d0-9f9f-6bb6a37a56ef admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:40.428717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:40.429486 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.429915 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.430348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.432453 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:40.432970 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:40.444499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1333/2692] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:40.448699 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:40.460426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef1dff-544b-4380-abc3-57a7071ac741 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:40.465385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55494c74-abb6-464b-97a3-9e5d67be24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:40.465981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494c74-abb6-464b-97a3-9e5d67be24a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.466256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494c74-abb6-464b-97a3-9e5d67be24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.466835 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55494c74-abb6-464b-97a3-9e5d67be24a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.467222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55494c74-abb6-464b-97a3-9e5d67be24a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:40.468912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55494c74-abb6-464b-97a3-9e5d67be24a6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:40.481265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1360/2693] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:40.485500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:40.491249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:40.496502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d93dc-a81a-44e8-b5bf-ea752a0f9193 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:40.501036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:40.501710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.502925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.503211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] PATH_INFO: `/v3/projects/c225da5462044092a105e5f03d6aba6e/users/9815d177287c427aac75de8cbfd129cb/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.518339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c225da5462044092a105e5f03d6aba6e, user_id=9815d177287c427aac75de8cbfd129cb, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:40.521030 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:40.579886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1334/2694] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:40 2022] PUT /identity/v3/projects/c225da5462044092a105e5f03d6aba6e/users/9815d177287c427aac75de8cbfd129cb/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:40.591375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3119d2f-2b7c-45d3-b069-3e61ac5be456 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.591704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3119d2f-2b7c-45d3-b069-3e61ac5be456 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.591979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3119d2f-2b7c-45d3-b069-3e61ac5be456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.619949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-c3119d2f-2b7c-45d3-b069-3e61ac5be456 None None] MFA Rules not processed for user `9815d177287c427aac75de8cbfd129cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:40.621153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c3119d2f-2b7c-45d3-b069-3e61ac5be456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:40.625111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:40.685594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1361/2695] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:40.703314 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:40.705887 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:40.764558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aabba-c20d-4ce5-b10d-4a22db22cef3 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:40.768792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdbf5a-4ba9-4775-a03c-432d9b5a7121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:40.769399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdbf5a-4ba9-4775-a03c-432d9b5a7121 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:40.769678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdbf5a-4ba9-4775-a03c-432d9b5a7121 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:40.769953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdbf5a-4ba9-4775-a03c-432d9b5a7121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:40.778936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdbf5a-4ba9-4775-a03c-432d9b5a7121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:40.781006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdbf5a-4ba9-4775-a03c-432d9b5a7121 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:40.789700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1335/2696] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:44.537427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3119d2f-2b7c-45d3-b069-3e61ac5be456 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:44.598622 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3119d2f-2b7c-45d3-b069-3e61ac5be456 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:44.603078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:44.603734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:44.604013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:44.604291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] PATH_INFO: `/v3/users/9815d177287c427aac75de8cbfd129cb` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:44.605385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] RBAC: Authorizing `identity:delete_user(user_id=9815d177287c427aac75de8cbfd129cb)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:44.607297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:44.814821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9815d177287c427aac75de8cbfd129cb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:44.815496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9815d177287c427aac75de8cbfd129cb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:44.827381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9815d177287c427aac75de8cbfd129cb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:44.893231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9815d177287c427aac75de8cbfd129cb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:44.894468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9815d177287c427aac75de8cbfd129cb'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:44.906635 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1362/2697] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:44 2022] DELETE /identity/v3/users/9815d177287c427aac75de8cbfd129cb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:44.911244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57468d-99cc-48b2-baa9-cfbc2f1fd6b5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:44.911756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57468d-99cc-48b2-baa9-cfbc2f1fd6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:44.911861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57468d-99cc-48b2-baa9-cfbc2f1fd6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:44.932244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-aa57468d-99cc-48b2-baa9-cfbc2f1fd6b5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:44.933434 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-aa57468d-99cc-48b2-baa9-cfbc2f1fd6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:44.993561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1336/2698] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:45.003827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:45.005380 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:45.035003 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:45.065202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47890c3-92b2-4e8a-948d-8d2bad72bede admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:45.069764 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:45.070365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:45.070640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:45.070908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:45.080877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:45.083210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:45.093574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1363/2699] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:45.370228 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:45.370365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:45.370712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:45.390916 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:45.392238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:45.452987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1337/2700] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 28 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:45.467590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:45.468899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:45.559023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:45.559023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:45.560693 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8262b1-7ae1-4430-80f0-57570e0deb3c service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:45.566996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e4aeb-9446-4dfe-83c7-63e6dd9c8f8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:45.567833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e4aeb-9446-4dfe-83c7-63e6dd9c8f8b service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:45.568180 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e4aeb-9446-4dfe-83c7-63e6dd9c8f8b service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:45.568567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e4aeb-9446-4dfe-83c7-63e6dd9c8f8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:45.580235 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e4aeb-9446-4dfe-83c7-63e6dd9c8f8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:45.582678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e4aeb-9446-4dfe-83c7-63e6dd9c8f8b service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:45.591162 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93e730-8d3c-414b-a4ec-598b7be0a808 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:45.592873 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1364/2701] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:56:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:56:45.598684 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:45.599549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:45.599823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:45.600278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] PATH_INFO: `/v3/projects/c225da5462044092a105e5f03d6aba6e` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:45.601493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c225da5462044092a105e5f03d6aba6e)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:45.603592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:45.636974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:45.734924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c225da5462044092a105e5f03d6aba6e', 'request_id': 'req-23a57e5f-293b-4795-84a0-f4eedd31a615'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:45.742029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c225da5462044092a105e5f03d6aba6e', 'request_id': 'req-23a57e5f-293b-4795-84a0-f4eedd31a615'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:45.831036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c225da5462044092a105e5f03d6aba6e', 'request_id': 'req-23a57e5f-293b-4795-84a0-f4eedd31a615'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:45.842296 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] The token cache is being invalidate because project c225da5462044092a105e5f03d6aba6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:45.842580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:45.843208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-23a57e5f-293b-4795-84a0-f4eedd31a615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:45.844715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1338/2702] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:45 2022] DELETE /identity/v3/projects/c225da5462044092a105e5f03d6aba6e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:56:45.850186 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2152-55c0-4a43-b9f4-c4ebb61960c9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:45.850474 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2152-55c0-4a43-b9f4-c4ebb61960c9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:45.850751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2152-55c0-4a43-b9f4-c4ebb61960c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:45.872254 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-936b2152-55c0-4a43-b9f4-c4ebb61960c9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:45.873477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-936b2152-55c0-4a43-b9f4-c4ebb61960c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:45.958689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1365/2703] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:45.966914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcdc22-f3ef-44d8-8309-f6bba2555ff1 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:45.967528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcdc22-f3ef-44d8-8309-f6bba2555ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:45.967528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcdc22-f3ef-44d8-8309-f6bba2555ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:45.989980 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-bfdcdc22-f3ef-44d8-8309-f6bba2555ff1 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:45.991149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-bfdcdc22-f3ef-44d8-8309-f6bba2555ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:45.999113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1339/2704] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:46.003629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b2152-55c0-4a43-b9f4-c4ebb61960c9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:46.013090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b2152-55c0-4a43-b9f4-c4ebb61960c9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:46.017629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:46.018219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.018521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.019506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.023958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:46.023958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:46.023958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:46.033512 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1366/2705] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:56:46.038603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcdc22-f3ef-44d8-8309-f6bba2555ff1 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:46.052967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcdc22-f3ef-44d8-8309-f6bba2555ff1 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:46.053717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:46.054329 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.054644 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.054921 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.055595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:46.057482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:46.198436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1340/2706] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:46 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:46.202598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:46.213375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c95cbc-88d4-4347-a62a-cd98bfcfb35a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:46.257753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=100 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:46.273017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:46.273654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.273937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.274213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.274851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:46.276802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:46.362368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1367/2707] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:46 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:46.366599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:46.376865 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60657ebe-bc5d-4104-8e3b-f7eec5d15306 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:46.381997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:46.382589 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.382864 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.383130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.383805 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:46.385371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:46.395787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1341/2708] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:46.399698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:46.410510 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9713a-c23c-4767-a7b8-7944a5515a27 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:46.415711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1570e7-1e3d-4320-b8bd-1f7e37e7595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:46.416321 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1570e7-1e3d-4320-b8bd-1f7e37e7595f admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.416597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1570e7-1e3d-4320-b8bd-1f7e37e7595f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.416867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1570e7-1e3d-4320-b8bd-1f7e37e7595f admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.417507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1570e7-1e3d-4320-b8bd-1f7e37e7595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:46.419108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1570e7-1e3d-4320-b8bd-1f7e37e7595f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:46.429910 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1368/2709] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:46.434008 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:46.444455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cd298-b46e-4cd9-9cd2-0ac9ab09f980 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:46.449023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:46.449668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.449946 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.450213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] PATH_INFO: `/v3/projects/4e514f924c294c35bd4de4e57670a66a/users/641365bec55c43bbbaa3702fb2018dc4/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.465845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e514f924c294c35bd4de4e57670a66a, user_id=641365bec55c43bbbaa3702fb2018dc4, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:46.468511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:46.562023 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1342/2710] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:46 2022] PUT /identity/v3/projects/4e514f924c294c35bd4de4e57670a66a/users/641365bec55c43bbbaa3702fb2018dc4/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:46.572972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.573502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.573502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.601725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] MFA Rules not processed for user `641365bec55c43bbbaa3702fb2018dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:46.602931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:46.669826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1369/2711] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:46.681305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:46.683021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:46.742757 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a6c0-1b4c-4ff6-90c7-4637f2461659 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:46.746560 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ae337-0e7d-43e5-89ec-b054b73b238f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:46.747168 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae337-0e7d-43e5-89ec-b054b73b238f service glance] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:46.747472 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae337-0e7d-43e5-89ec-b054b73b238f service glance] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:46.747746 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae337-0e7d-43e5-89ec-b054b73b238f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:46.756289 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ae337-0e7d-43e5-89ec-b054b73b238f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:46.757705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ae337-0e7d-43e5-89ec-b054b73b238f service glance] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:46.766426 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1343/2712] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:56.290348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:56.291863 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:56.359768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def51a8-975f-4ea8-8174-a0d2e6f1d1e7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:56.364282 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:56.364917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:56.365196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:56.365471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] PATH_INFO: `/v3/users/f2d09e31f5a041cf985798a23dee2756` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:56.366581 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d09e31f5a041cf985798a23dee2756)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:56.368605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:56.576088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d09e31f5a041cf985798a23dee2756'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:56.576745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d09e31f5a041cf985798a23dee2756'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:56.581928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:56.590412 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d09e31f5a041cf985798a23dee2756'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:56.652296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d09e31f5a041cf985798a23dee2756'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:56.652901 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d09e31f5a041cf985798a23dee2756'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:56.666270 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1370/2713] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:56 2022] DELETE /identity/v3/users/f2d09e31f5a041cf985798a23dee2756 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:56.670877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:56.671384 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:56.671555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:56.691323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:56.692554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:56.738151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:56.753130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1344/2714] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:56.764171 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:56.765796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:56.826770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fa1be-59d8-4cc2-bbc3-a3f273f40c1f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:56.830370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:56.831031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:56.831341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:56.831660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:56.841660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:56.843081 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:56.852424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1371/2715] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:56:57.317945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:57.319370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:57.333949 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ffca-c65d-4982-8a45-89166cfe7541 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:57.339264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:57.339877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:57.340159 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:57.340443 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] PATH_INFO: `/v3/projects/12ecfd9cb0994b48ae581dde88687b51` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:57.341580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ecfd9cb0994b48ae581dde88687b51)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:57.343602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:57.454595 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ecfd9cb0994b48ae581dde88687b51', 'request_id': 'req-81ed4f66-a1b3-4344-8005-85c81c02dc47'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.460625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ecfd9cb0994b48ae581dde88687b51', 'request_id': 'req-81ed4f66-a1b3-4344-8005-85c81c02dc47'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.545268 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ecfd9cb0994b48ae581dde88687b51', 'request_id': 'req-81ed4f66-a1b3-4344-8005-85c81c02dc47'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.557243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] The token cache is being invalidate because project 12ecfd9cb0994b48ae581dde88687b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:57.557535 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.558156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.559674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1345/2716] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:57 2022] DELETE /identity/v3/projects/12ecfd9cb0994b48ae581dde88687b51 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:57.563694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:57.573305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9360a8-f6a4-457b-b289-5b4ba911a88f service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:57.630079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:57.630617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:57.630906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:57.631153 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] PATH_INFO: `/v3/users/febd880eea0b4a77a19293c548993a54` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:57.632304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=febd880eea0b4a77a19293c548993a54)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:57.634293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:57.804155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febd880eea0b4a77a19293c548993a54'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.805531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febd880eea0b4a77a19293c548993a54'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.818000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febd880eea0b4a77a19293c548993a54'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.956205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febd880eea0b4a77a19293c548993a54'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.956819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9c5ab6b4-b123-463b-b7c7-fd067ee675e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febd880eea0b4a77a19293c548993a54'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:57.962781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:57.970937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1372/2717] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:56:57 2022] DELETE /identity/v3/users/febd880eea0b4a77a19293c548993a54 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:58.363774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:58.365235 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:58.379728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed4f66-a1b3-4344-8005-85c81c02dc47 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:58.438870 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:58.439440 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:58.439733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:58.440006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] PATH_INFO: `/v3/projects/8d12aade8cc0484ba2a8d00c09d2d9dd` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:58.441114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d12aade8cc0484ba2a8d00c09d2d9dd)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:58.443059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:58.562569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d12aade8cc0484ba2a8d00c09d2d9dd', 'request_id': 'req-e6b7030f-33de-4c74-b084-9e9b15a62edd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:58.568878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d12aade8cc0484ba2a8d00c09d2d9dd', 'request_id': 'req-e6b7030f-33de-4c74-b084-9e9b15a62edd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:58.641714 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d12aade8cc0484ba2a8d00c09d2d9dd', 'request_id': 'req-e6b7030f-33de-4c74-b084-9e9b15a62edd'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:58.653495 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] The token cache is being invalidate because project 8d12aade8cc0484ba2a8d00c09d2d9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:56:58.653777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:58.654399 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-e6b7030f-33de-4c74-b084-9e9b15a62edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:56:58.655905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1346/2718] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:56:58 2022] DELETE /identity/v3/projects/8d12aade8cc0484ba2a8d00c09d2d9dd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:58.660716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efe9e6-e6ab-49e8-a493-015a26b16dd8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:58.663912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efe9e6-e6ab-49e8-a493-015a26b16dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:58.663912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efe9e6-e6ab-49e8-a493-015a26b16dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:58.681433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-70efe9e6-e6ab-49e8-a493-015a26b16dd8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:58.682618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-70efe9e6-e6ab-49e8-a493-015a26b16dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:58.740892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1373/2719] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:58.748764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fab52-11e9-4a8c-814c-9519a5911614 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:58.749053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fab52-11e9-4a8c-814c-9519a5911614 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:58.749330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fab52-11e9-4a8c-814c-9519a5911614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:58.757005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:58.769299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-512fab52-11e9-4a8c-814c-9519a5911614 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:58.770498 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-512fab52-11e9-4a8c-814c-9519a5911614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:58.778925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1347/2720] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:56:58.783036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efe9e6-e6ab-49e8-a493-015a26b16dd8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:58.793291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efe9e6-e6ab-49e8-a493-015a26b16dd8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:58.798078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:58.798669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:58.798978 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:58.799255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:58.799936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:56:58.800288 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:58.801930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:58.813713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1374/2721] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:56:58.817968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fab52-11e9-4a8c-814c-9519a5911614 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:58.827114 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fab52-11e9-4a8c-814c-9519a5911614 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:58.831873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:58.832480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:58.832763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:58.833096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:58.833784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:58.835711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:58.957819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1348/2722] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:58 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:56:58.963074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:58.973096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d9c00-0198-4963-ad39-ce4866c35481 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.030327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.030919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.031194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.031489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.032117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.034025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.161127 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1375/2723] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:58 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:59.165213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.175436 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1444c0-7079-44ce-b375-60add49edeeb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.180245 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.180952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.181239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.181520 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.182160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.183809 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.203391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1349/2724] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:59.203524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.209354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace073fe-0e37-489b-9ade-d760e26bf02f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.214947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de259-1280-45ca-9193-fd59594aa0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.215565 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de259-1280-45ca-9193-fd59594aa0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.215842 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de259-1280-45ca-9193-fd59594aa0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.216111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de259-1280-45ca-9193-fd59594aa0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.216741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98de259-1280-45ca-9193-fd59594aa0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.218370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98de259-1280-45ca-9193-fd59594aa0eb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.227973 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1376/2725] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:59.232086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.241918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ee987-a91e-40c6-98a3-3f6ae65e66df admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.246721 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.247363 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.247677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.247952 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] PATH_INFO: `/v3/projects/4bc59bfdc33e4b318045cab5902ba4e0/users/884edf76a7ec48ed8be639aa3adba4e4/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.263368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc59bfdc33e4b318045cab5902ba4e0, user_id=884edf76a7ec48ed8be639aa3adba4e4, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.266065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.333406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1350/2726] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:59 2022] PUT /identity/v3/projects/4bc59bfdc33e4b318045cab5902ba4e0/users/884edf76a7ec48ed8be639aa3adba4e4/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:59.346640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ba1bd-c787-4aca-af70-3c3b8ff7856f None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.346990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ba1bd-c787-4aca-af70-3c3b8ff7856f None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.353889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ba1bd-c787-4aca-af70-3c3b8ff7856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.375807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f82ba1bd-c787-4aca-af70-3c3b8ff7856f None None] MFA Rules not processed for user `884edf76a7ec48ed8be639aa3adba4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:56:59.377098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f82ba1bd-c787-4aca-af70-3c3b8ff7856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:56:59.424369 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:59.442758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1377/2727] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:56:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:56:59.448556 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.510910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e3297-acd8-4b59-81f8-42e5e49a0883 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.515643 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.516246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.517323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.517323 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.517527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.519263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.610080 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1351/2728] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:56:59 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:59.613974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ba1bd-c787-4aca-af70-3c3b8ff7856f None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.625507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ba1bd-c787-4aca-af70-3c3b8ff7856f None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.683249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.683935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.684158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.684435 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.685079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.687048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.767730 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1378/2729] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:56:59 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:56:59.771959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.782455 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11978953-7fa3-4cfc-b94b-cca6deee3936 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.787171 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.787800 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.788082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.788359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.788992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.791163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.801598 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1352/2730] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:56:59.806155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.816065 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd140c6-2368-412a-944f-f54dd5bc3abe admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:56:59.820644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:56:59.821328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:56:59.821604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:56:59.821875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] PATH_INFO: `/v3/projects/2cadd0ed2c8142b9a89f34913d86e727/users/9ae7322ea37e4ce5a927b899f9c7b659/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:56:59.836927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cadd0ed2c8142b9a89f34913d86e727, user_id=9ae7322ea37e4ce5a927b899f9c7b659, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:56:59.840247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:56:59.951060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1379/2731] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:56:59 2022] PUT /identity/v3/projects/2cadd0ed2c8142b9a89f34913d86e727/users/9ae7322ea37e4ce5a927b899f9c7b659/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:56:59.955305 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:56:59.965608 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737df205-6810-4787-924a-906c43e2adcf admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:00.022261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addbe44-7ce0-42b7-824f-300df4d3b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:00.022867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbe44-7ce0-42b7-824f-300df4d3b025 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:00.023148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbe44-7ce0-42b7-824f-300df4d3b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:00.023446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbe44-7ce0-42b7-824f-300df4d3b025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:00.024137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addbe44-7ce0-42b7-824f-300df4d3b025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:00.025717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addbe44-7ce0-42b7-824f-300df4d3b025 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:00.035706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1353/2732] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:00.040544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:00.051178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cba71-3945-4c9f-a0d8-38dc2c7460fb admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:00.057013 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:00.060751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:00.060751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:00.060751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] PATH_INFO: `/v3/projects/2cadd0ed2c8142b9a89f34913d86e727/users/9ae7322ea37e4ce5a927b899f9c7b659/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:00.060751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cadd0ed2c8142b9a89f34913d86e727, user_id=9ae7322ea37e4ce5a927b899f9c7b659, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:00.062734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:00.073405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1380/2733] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:00 2022] PUT /identity/v3/projects/2cadd0ed2c8142b9a89f34913d86e727/users/9ae7322ea37e4ce5a927b899f9c7b659/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:00.083636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223da35-0c69-4cca-9a43-53add508ee7e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:00.083969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223da35-0c69-4cca-9a43-53add508ee7e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:00.084244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223da35-0c69-4cca-9a43-53add508ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:00.105224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:00.113519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f223da35-0c69-4cca-9a43-53add508ee7e None None] MFA Rules not processed for user `9ae7322ea37e4ce5a927b899f9c7b659`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:00.114715 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f223da35-0c69-4cca-9a43-53add508ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:00.181209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1354/2734] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:00.191867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:00.193546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:00.253678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36875ae1-a6f4-452d-8ff3-5f1d04f79230 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:00.259082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:00.259082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:00.259082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:00.259082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:00.269172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:00.270591 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:00.280967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1381/2735] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:00.383822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223da35-0c69-4cca-9a43-53add508ee7e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:00.393600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223da35-0c69-4cca-9a43-53add508ee7e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:00.397284 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acffa3e-1aad-4a14-b79f-5767247cfc2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:00.397896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acffa3e-1aad-4a14-b79f-5767247cfc2c service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:00.398178 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acffa3e-1aad-4a14-b79f-5767247cfc2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:00.398451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acffa3e-1aad-4a14-b79f-5767247cfc2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:00.455043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acffa3e-1aad-4a14-b79f-5767247cfc2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:00.456433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acffa3e-1aad-4a14-b79f-5767247cfc2c service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:00.466130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1355/2736] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:03.556937 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:03.608049 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:03.624172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d35f0-5234-4d66-930c-188aff905c9f service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:03.628897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:03.629522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:03.629803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:03.630102 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] PATH_INFO: `/v3/users/884edf76a7ec48ed8be639aa3adba4e4` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:03.631247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884edf76a7ec48ed8be639aa3adba4e4)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:03.633758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:03.879155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884edf76a7ec48ed8be639aa3adba4e4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:03.879768 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884edf76a7ec48ed8be639aa3adba4e4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:03.892296 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884edf76a7ec48ed8be639aa3adba4e4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:03.956562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884edf76a7ec48ed8be639aa3adba4e4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:03.957268 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884edf76a7ec48ed8be639aa3adba4e4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:03.970331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1382/2737] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:03 2022] DELETE /identity/v3/users/884edf76a7ec48ed8be639aa3adba4e4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:03.974804 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:03.975255 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:03.975354 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:03.996076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:03.997392 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:04.058375 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1356/2738] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:04.068175 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:04.069593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:04.126970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a5f73-4af8-4e97-8d3f-d478eeec5070 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:04.130669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:04.131208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:04.131522 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:04.131823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:04.141575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:04.143025 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:04.152570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1383/2739] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:04.564549 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:04.566137 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:04.589820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e63b-6ce8-434b-8272-8b6e68d45976 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:04.594781 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:04.595438 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:04.595741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:04.596074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] PATH_INFO: `/v3/projects/4bc59bfdc33e4b318045cab5902ba4e0` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:04.597229 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc59bfdc33e4b318045cab5902ba4e0)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:04.599134 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:04.690340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:04.705469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc59bfdc33e4b318045cab5902ba4e0', 'request_id': 'req-51be90ea-4785-41f3-ae3e-6ef77f17cae8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:04.712860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc59bfdc33e4b318045cab5902ba4e0', 'request_id': 'req-51be90ea-4785-41f3-ae3e-6ef77f17cae8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:04.779157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc59bfdc33e4b318045cab5902ba4e0', 'request_id': 'req-51be90ea-4785-41f3-ae3e-6ef77f17cae8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:04.790231 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] The token cache is being invalidate because project 4bc59bfdc33e4b318045cab5902ba4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:04.790517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:04.791339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:04.793886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1357/2740] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:04 2022] DELETE /identity/v3/projects/4bc59bfdc33e4b318045cab5902ba4e0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:04.798546 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:04.808755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025731f-98a6-40b2-87db-8d3d5935c16c service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:04.865385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:04.866007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:04.866287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:04.866559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] PATH_INFO: `/v3/users/9ae7322ea37e4ce5a927b899f9c7b659` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:04.867847 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae7322ea37e4ce5a927b899f9c7b659)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:04.869828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:04.875090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:05.084336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae7322ea37e4ce5a927b899f9c7b659'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.085006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae7322ea37e4ce5a927b899f9c7b659'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.097227 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae7322ea37e4ce5a927b899f9c7b659'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.178629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae7322ea37e4ce5a927b899f9c7b659'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.179247 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-a1f50958-c488-4d90-8eba-4498bbdcefc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae7322ea37e4ce5a927b899f9c7b659'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.192297 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1384/2741] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:04 2022] DELETE /identity/v3/users/9ae7322ea37e4ce5a927b899f9c7b659 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:05.608509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:05.610068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:05.625493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be90ea-4785-41f3-ae3e-6ef77f17cae8 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:05.682551 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:05.692029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:05.692029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:05.692029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] PATH_INFO: `/v3/projects/2cadd0ed2c8142b9a89f34913d86e727` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:05.692029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cadd0ed2c8142b9a89f34913d86e727)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:05.692029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:05.796566 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cadd0ed2c8142b9a89f34913d86e727', 'request_id': 'req-0aeb89da-7895-4d34-ad0a-80ec2af705db'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.802832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cadd0ed2c8142b9a89f34913d86e727', 'request_id': 'req-0aeb89da-7895-4d34-ad0a-80ec2af705db'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.876156 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cadd0ed2c8142b9a89f34913d86e727', 'request_id': 'req-0aeb89da-7895-4d34-ad0a-80ec2af705db'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.887045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] The token cache is being invalidate because project 2cadd0ed2c8142b9a89f34913d86e727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:05.889737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.889737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-0aeb89da-7895-4d34-ad0a-80ec2af705db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:05.889737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1358/2742] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:05 2022] DELETE /identity/v3/projects/2cadd0ed2c8142b9a89f34913d86e727 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:05.894422 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d9fb-0caf-48df-a68a-ae04a254037a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:05.894921 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d9fb-0caf-48df-a68a-ae04a254037a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:05.895026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d9fb-0caf-48df-a68a-ae04a254037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:05.916819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-2a59d9fb-0caf-48df-a68a-ae04a254037a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:05.918024 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2a59d9fb-0caf-48df-a68a-ae04a254037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:05.987377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1385/2743] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:05.994197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3977a6-5ac8-4a91-8269-64d5874ae19a None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:05.994481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3977a6-5ac8-4a91-8269-64d5874ae19a None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:05.994755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3977a6-5ac8-4a91-8269-64d5874ae19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.014606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-2a3977a6-5ac8-4a91-8269-64d5874ae19a None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:06.015856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2a3977a6-5ac8-4a91-8269-64d5874ae19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:06.024113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1359/2744] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:06.028865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59d9fb-0caf-48df-a68a-ae04a254037a None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:06.038689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59d9fb-0caf-48df-a68a-ae04a254037a None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:06.044104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:06.044706 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.044988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.050421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.050421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:57:06.050421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:06.050421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:06.060956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1386/2745] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:57:06.065330 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3977a6-5ac8-4a91-8269-64d5874ae19a None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:06.074756 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3977a6-5ac8-4a91-8269-64d5874ae19a None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:06.080149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:06.080149 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.080507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.080783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.081433 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:06.083295 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:06.198834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1360/2746] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:06 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:06.203098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:06.219141 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507a54d-0218-4427-8774-69ac6260315f admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:06.279224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:06.279869 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.280146 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.280414 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.281032 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:06.282932 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:06.378751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1387/2747] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:06 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:06.383062 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:06.394148 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30abab9-a867-4dd4-8765-f09f8cc9e377 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:06.398861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:06.399547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.399833 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.400109 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.400748 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:06.402336 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:06.412357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1361/2748] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:06.422452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:06.427690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:06.433640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de96a2-63d3-42bc-8163-02953dd73906 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:06.438294 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32799e28-f11f-4c7d-b6ce-68e1f0cdfb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:06.442684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799e28-f11f-4c7d-b6ce-68e1f0cdfb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.442684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799e28-f11f-4c7d-b6ce-68e1f0cdfb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.442684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799e28-f11f-4c7d-b6ce-68e1f0cdfb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.442684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32799e28-f11f-4c7d-b6ce-68e1f0cdfb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:06.442684 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32799e28-f11f-4c7d-b6ce-68e1f0cdfb21 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:06.452908 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1388/2749] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:06.456962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:06.467180 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61437-87e5-45df-a8fe-12fc9f5af886 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:06.471846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:06.472485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.472762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.473032 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] PATH_INFO: `/v3/projects/ccb517420aca4ffe97b17e355babaeca/users/11f733938ca54d10b3cd55aef17af329/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.475263 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:06.488561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb517420aca4ffe97b17e355babaeca, user_id=11f733938ca54d10b3cd55aef17af329, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:06.491209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:06.583651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1362/2750] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:06 2022] PUT /identity/v3/projects/ccb517420aca4ffe97b17e355babaeca/users/11f733938ca54d10b3cd55aef17af329/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:06.589014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0361-ec8f-4cab-a853-d330e5d75ec4 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.589301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0361-ec8f-4cab-a853-d330e5d75ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.589574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0361-ec8f-4cab-a853-d330e5d75ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.609009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-ed0a0361-ec8f-4cab-a853-d330e5d75ec4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:06.610190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ed0a0361-ec8f-4cab-a853-d330e5d75ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:06.668002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1389/2751] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:06.677740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:06.680209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:06.737380 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953be1b0-303c-43e3-9dbc-b31f77e886eb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:06.740920 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:06.741521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:06.741832 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:06.742112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:06.751044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:06.752492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:06.762301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1363/2752] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:08.014190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194fcc6-fdc5-4390-a4a9-b1472a64fe85 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:08.014784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194fcc6-fdc5-4390-a4a9-b1472a64fe85 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:08.015101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194fcc6-fdc5-4390-a4a9-b1472a64fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:08.045255 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b194fcc6-fdc5-4390-a4a9-b1472a64fe85 None None] MFA Rules not processed for user `11f733938ca54d10b3cd55aef17af329`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:08.046498 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b194fcc6-fdc5-4390-a4a9-b1472a64fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:08.113136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1390/2753] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:08.117624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:08.127273 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf47e5-f995-4468-b2cf-1014faaccc56 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:08.131839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:08.132430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:08.132719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:08.133474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:08.134450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:08.136407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:08.254461 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1364/2754] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:08 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:08.259079 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194fcc6-fdc5-4390-a4a9-b1472a64fe85 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:08.269683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194fcc6-fdc5-4390-a4a9-b1472a64fe85 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:08.325784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:08.326384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:08.326659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:08.326931 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:08.327582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:08.329473 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:08.391053 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1391/2755] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:08 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:08.394997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:08.405328 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d3612-7645-4245-a0ac-ce64f93d8178 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:08.409891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:08.410482 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:08.410768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:08.411040 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:08.411710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:08.413276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:08.423910 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1365/2756] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:08.428096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:08.438883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73b930-310f-4f9d-8bda-a2f395b62e98 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:08.443596 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:08.444237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:08.444570 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:08.444866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] PATH_INFO: `/v3/projects/054fd78982bd4b7e9acaa991ad990424/users/f7624703826d443698f79b3f9d5a25d9/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:08.454335 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:08.460553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] RBAC: Authorizing `identity:create_grant(project_id=054fd78982bd4b7e9acaa991ad990424, user_id=f7624703826d443698f79b3f9d5a25d9, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:08.463543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:08.568752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1392/2757] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:08 2022] PUT /identity/v3/projects/054fd78982bd4b7e9acaa991ad990424/users/f7624703826d443698f79b3f9d5a25d9/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:08.573365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:08.583792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824851a-0649-4f7a-8481-e79b98c76dc0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:08.649208 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c8963-5bed-47bc-857a-2e00fc423b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:08.649755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8963-5bed-47bc-857a-2e00fc423b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:08.650036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8963-5bed-47bc-857a-2e00fc423b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:08.650311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c8963-5bed-47bc-857a-2e00fc423b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:08.650998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c8963-5bed-47bc-857a-2e00fc423b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:08.652948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c8963-5bed-47bc-857a-2e00fc423b48 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:08.662722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1366/2758] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:08.667629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:08.677667 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0b430-9d3a-4544-ad58-6869e509204e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:08.682940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143840-b725-4725-aa65-449a94d2fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:08.683824 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143840-b725-4725-aa65-449a94d2fc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:08.684071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143840-b725-4725-aa65-449a94d2fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:08.684382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143840-b725-4725-aa65-449a94d2fc84 admin admin] PATH_INFO: `/v3/projects/054fd78982bd4b7e9acaa991ad990424/users/f7624703826d443698f79b3f9d5a25d9/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:08.686252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143840-b725-4725-aa65-449a94d2fc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054fd78982bd4b7e9acaa991ad990424, user_id=f7624703826d443698f79b3f9d5a25d9, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:08.688904 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143840-b725-4725-aa65-449a94d2fc84 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:08.700184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1393/2759] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:08 2022] PUT /identity/v3/projects/054fd78982bd4b7e9acaa991ad990424/users/f7624703826d443698f79b3f9d5a25d9/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:10.176458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd181-c581-4030-b815-05fb487a381c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:10.177014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd181-c581-4030-b815-05fb487a381c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:10.177359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dd181-c581-4030-b815-05fb487a381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:10.207733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-500dd181-c581-4030-b815-05fb487a381c None None] MFA Rules not processed for user `f7624703826d443698f79b3f9d5a25d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:10.208963 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-500dd181-c581-4030-b815-05fb487a381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:10.251340 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:10.293309 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1367/2760] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:10.305002 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:10.305603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:10.305603 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:10.325260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] MFA Rules not processed for user `11f733938ca54d10b3cd55aef17af329`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:10.326509 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:10.380495 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1394/2761] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:10.393404 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd181-c581-4030-b815-05fb487a381c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:10.394846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-500dd181-c581-4030-b815-05fb487a381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:10.468645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dd181-c581-4030-b815-05fb487a381c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:10.474202 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d480dc-e6fe-43f1-8366-beca6e76da76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:10.474808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d480dc-e6fe-43f1-8366-beca6e76da76 service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:10.475089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d480dc-e6fe-43f1-8366-beca6e76da76 service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:10.475365 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d480dc-e6fe-43f1-8366-beca6e76da76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:10.483876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d480dc-e6fe-43f1-8366-beca6e76da76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:10.485437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d480dc-e6fe-43f1-8366-beca6e76da76 service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:10.494322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1368/2762] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:11.233849 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:11.235376 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:11.308407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d35c11-ad95-48b2-bd4a-6e029b072a63 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:11.313196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:11.313837 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:11.314120 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:11.314399 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] PATH_INFO: `/v3/users/641365bec55c43bbbaa3702fb2018dc4` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:11.315735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641365bec55c43bbbaa3702fb2018dc4)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:11.317678 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:11.552875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641365bec55c43bbbaa3702fb2018dc4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:11.553550 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641365bec55c43bbbaa3702fb2018dc4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:11.566741 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641365bec55c43bbbaa3702fb2018dc4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:11.641607 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641365bec55c43bbbaa3702fb2018dc4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:11.642249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641365bec55c43bbbaa3702fb2018dc4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:11.650890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:11.656222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1395/2763] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:11 2022] DELETE /identity/v3/users/641365bec55c43bbbaa3702fb2018dc4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:11.661217 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:11.661677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:11.661677 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:11.680926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:11.682733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:11.743406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1369/2764] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:11.753598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:11.755059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:11.814285 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2a01-5ea9-4db2-a24c-7de0f400db55 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:11.818111 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:11.820755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:11.820755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:11.820755 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:11.829818 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:11.831253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:11.841929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1396/2765] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:12.300374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:12.307732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:12.317704 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dbb5e-a27f-41b2-80d1-df415ef29830 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:12.323310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:12.324050 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:12.324352 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:12.324614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] PATH_INFO: `/v3/projects/4e514f924c294c35bd4de4e57670a66a` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:12.325750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e514f924c294c35bd4de4e57670a66a)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:12.327683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:12.468562 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e514f924c294c35bd4de4e57670a66a', 'request_id': 'req-ac3c8972-e54a-478c-b711-49ba130fd055'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:12.476237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e514f924c294c35bd4de4e57670a66a', 'request_id': 'req-ac3c8972-e54a-478c-b711-49ba130fd055'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:12.478038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:12.596034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e514f924c294c35bd4de4e57670a66a', 'request_id': 'req-ac3c8972-e54a-478c-b711-49ba130fd055'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:12.608911 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] The token cache is being invalidate because project 4e514f924c294c35bd4de4e57670a66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:12.609204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:12.609854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:12.611531 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1370/2766] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:12 2022] DELETE /identity/v3/projects/4e514f924c294c35bd4de4e57670a66a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:21.836742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=27 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:22.875902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:27.806005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:27.807482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:27.864050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2fa2-39c1-46c1-8ec4-475fd91c4d8d service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:27.913614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:27.914222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:27.914502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:27.914776 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:27.916524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:27.980109 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:27.981534 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:27.991129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1397/2767] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:29.950573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:29.953182 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:30.009460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c8972-e54a-478c-b711-49ba130fd055 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:30.013097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:30.013700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:30.014599 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:30.014872 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:30.016587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:30.080672 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:30.082095 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:30.092031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1371/2768] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:33.916751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:33.926916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:33.935387 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae25d7-fb50-4204-b918-6bb187180406 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:33.940493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:33.941119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:33.941401 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:33.941673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] PATH_INFO: `/v3/users/24ae810cf4bf4014bc455d4653eb77f8` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:33.942780 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ae810cf4bf4014bc455d4653eb77f8)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:33.944727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:34.145650 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ae810cf4bf4014bc455d4653eb77f8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.146506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ae810cf4bf4014bc455d4653eb77f8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.157956 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:34.160651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ae810cf4bf4014bc455d4653eb77f8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.247553 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ae810cf4bf4014bc455d4653eb77f8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.248231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-2f5d6822-3186-4bb8-adbb-e424681bbc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ae810cf4bf4014bc455d4653eb77f8'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.260879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1398/2769] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:33 2022] DELETE /identity/v3/users/24ae810cf4bf4014bc455d4653eb77f8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:34.528497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:34.539056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6dc4-5d7a-4b54-9cf6-c44068482346 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:34.619779 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:34.620545 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:34.620889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:34.621301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] PATH_INFO: `/v3/projects/c177b52ac3474620b411870ef03affe1` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:34.622487 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c177b52ac3474620b411870ef03affe1)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:34.625077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:34.755215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c177b52ac3474620b411870ef03affe1', 'request_id': 'req-2acd5655-4dda-4d37-aff7-3b60d7193067'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.757072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:34.761435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c177b52ac3474620b411870ef03affe1', 'request_id': 'req-2acd5655-4dda-4d37-aff7-3b60d7193067'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.868293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c177b52ac3474620b411870ef03affe1', 'request_id': 'req-2acd5655-4dda-4d37-aff7-3b60d7193067'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.879954 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] The token cache is being invalidate because project c177b52ac3474620b411870ef03affe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:34.880244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.880880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-2acd5655-4dda-4d37-aff7-3b60d7193067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:34.882550 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1372/2770] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:34 2022] DELETE /identity/v3/projects/c177b52ac3474620b411870ef03affe1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:34.887277 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cbf3-cc4d-4196-90ee-ac94d3190ecf None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:34.887611 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cbf3-cc4d-4196-90ee-ac94d3190ecf None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:34.887890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59cbf3-cc4d-4196-90ee-ac94d3190ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:34.907293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-3e59cbf3-cc4d-4196-90ee-ac94d3190ecf None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:34.908517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3e59cbf3-cc4d-4196-90ee-ac94d3190ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:34.978922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1399/2771] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:34.987039 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999549-d5a7-4039-8e4f-e085459992f6 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:34.987383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999549-d5a7-4039-8e4f-e085459992f6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:34.987693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999549-d5a7-4039-8e4f-e085459992f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.006957 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3d999549-d5a7-4039-8e4f-e085459992f6 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:35.008169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3d999549-d5a7-4039-8e4f-e085459992f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:35.016891 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1373/2772] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:35.021242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cbf3-cc4d-4196-90ee-ac94d3190ecf None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.031527 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59cbf3-cc4d-4196-90ee-ac94d3190ecf None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.036112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.036708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.036988 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.037324 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.037914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:57:35.038219 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.039945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:35.051791 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1400/2773] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:57:35.056140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d999549-d5a7-4039-8e4f-e085459992f6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.065710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d999549-d5a7-4039-8e4f-e085459992f6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.070493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.071104 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.071386 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.071700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.072335 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.074232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:35.185473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1374/2774] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:35.190188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.200513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a927f6-4003-4275-84a1-276c9a209dd6 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.259211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.259851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.264597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.264597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.264597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.264597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:35.340112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1401/2775] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:35 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:35.344141 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.355184 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116041ed-6fdf-4038-91f4-1edb4a134d83 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.359839 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.360883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.361163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.361435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.362107 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.363739 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:35.375237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1375/2776] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:35.379960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.390788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6dc33-d080-4821-a4c7-682c16d7f0c2 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.395492 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fd03c-d16d-4abe-8dc3-2a181a1884f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.396092 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fd03c-d16d-4abe-8dc3-2a181a1884f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.396372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fd03c-d16d-4abe-8dc3-2a181a1884f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.396644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fd03c-d16d-4abe-8dc3-2a181a1884f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.397891 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fd03c-d16d-4abe-8dc3-2a181a1884f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.399549 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fd03c-d16d-4abe-8dc3-2a181a1884f8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:35.409813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1402/2777] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:35.414092 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.424225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1aa60-b5f1-4241-b6cb-8f408be3abd9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.428869 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.429511 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.429795 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.430071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] PATH_INFO: `/v3/projects/400613d5fcdc4adeb3cb30413d9a23b2/users/cf90308d989a4ffb90b55ff5d4b4f935/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.446683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400613d5fcdc4adeb3cb30413d9a23b2, user_id=cf90308d989a4ffb90b55ff5d4b4f935, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.449720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:35.551004 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1376/2778] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:35 2022] PUT /identity/v3/projects/400613d5fcdc4adeb3cb30413d9a23b2/users/cf90308d989a4ffb90b55ff5d4b4f935/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:35.563899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3143e-a315-49a7-befd-58258d664859 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.564190 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3143e-a315-49a7-befd-58258d664859 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.564488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3143e-a315-49a7-befd-58258d664859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.598019 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-13a3143e-a315-49a7-befd-58258d664859 None None] MFA Rules not processed for user `cf90308d989a4ffb90b55ff5d4b4f935`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:35.599249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-13a3143e-a315-49a7-befd-58258d664859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:35.635806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:35.671946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1403/2779] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:35.676582 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.744278 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73435-6926-46b7-9358-c1147b83f830 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.749856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.750497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.750776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.751048 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.751706 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.753621 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:35.862121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1377/2780] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:35.864851 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3143e-a315-49a7-befd-58258d664859 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:35.876823 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3143e-a315-49a7-befd-58258d664859 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:35.945405 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:35.946096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:35.946371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:35.946640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:35.947651 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:35.949577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:36.063160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1404/2781] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:35 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:36.067086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:36.077312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a3621-1f0b-483e-a736-616934becb3a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:36.082237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:36.082924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:36.083288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:36.083649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:36.084303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:36.086169 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:36.097799 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1378/2782] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:36.102080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:36.113438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947bcec-7751-4225-a4ff-f7bddffe03f8 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:36.118305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:36.118979 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:36.119256 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:36.119562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] PATH_INFO: `/v3/projects/10d93ed77df7466095dd4dace980a82d/users/1642a9d6852c42ddae90d9a76efa1979/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:36.136669 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d93ed77df7466095dd4dace980a82d, user_id=1642a9d6852c42ddae90d9a76efa1979, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:36.139379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:36.228338 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1405/2783] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:36 2022] PUT /identity/v3/projects/10d93ed77df7466095dd4dace980a82d/users/1642a9d6852c42ddae90d9a76efa1979/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:36.232301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:36.242902 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0f648-2b2a-43b6-9390-466f748151f8 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:36.289038 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:36.300000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37a39f-bb30-48c0-b64e-c6243c14d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:36.300783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37a39f-bb30-48c0-b64e-c6243c14d943 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:36.301066 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37a39f-bb30-48c0-b64e-c6243c14d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:36.301339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37a39f-bb30-48c0-b64e-c6243c14d943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:36.301990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37a39f-bb30-48c0-b64e-c6243c14d943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:36.303603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37a39f-bb30-48c0-b64e-c6243c14d943 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:36.313856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1379/2784] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:36.326703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:36.337825 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ceaeb-f3a2-4213-915e-eab088f10980 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:36.343385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:36.344075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:36.344348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:36.344616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] PATH_INFO: `/v3/projects/10d93ed77df7466095dd4dace980a82d/users/1642a9d6852c42ddae90d9a76efa1979/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:36.346613 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d93ed77df7466095dd4dace980a82d, user_id=1642a9d6852c42ddae90d9a76efa1979, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:36.349572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:36.377708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1406/2785] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:36 2022] PUT /identity/v3/projects/10d93ed77df7466095dd4dace980a82d/users/1642a9d6852c42ddae90d9a76efa1979/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:36.387928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcd858-399e-4fdb-9077-5999eee3cec6 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:36.388215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcd858-399e-4fdb-9077-5999eee3cec6 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:36.388509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcd858-399e-4fdb-9077-5999eee3cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:36.418697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7fdcd858-399e-4fdb-9077-5999eee3cec6 None None] MFA Rules not processed for user `1642a9d6852c42ddae90d9a76efa1979`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:36.420044 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7fdcd858-399e-4fdb-9077-5999eee3cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:36.486693 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1380/2786] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:36.497537 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:36.499907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:36.558026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d40a1-1531-4e9b-8623-cf8e74814594 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:36.562366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c48e4-7211-4c25-a069-3d1b79f99100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:36.562971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c48e4-7211-4c25-a069-3d1b79f99100 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:36.563251 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c48e4-7211-4c25-a069-3d1b79f99100 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:36.563561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c48e4-7211-4c25-a069-3d1b79f99100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:36.572887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c48e4-7211-4c25-a069-3d1b79f99100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:36.574317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c48e4-7211-4c25-a069-3d1b79f99100 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:36.584425 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1407/2787] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:37.050254 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcd858-399e-4fdb-9077-5999eee3cec6 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:37.110555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcd858-399e-4fdb-9077-5999eee3cec6 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:37.115009 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:37.115655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:37.115936 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:37.116207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] PATH_INFO: `/v3/users/cf90308d989a4ffb90b55ff5d4b4f935` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:37.117325 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf90308d989a4ffb90b55ff5d4b4f935)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:37.119211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:37.289239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf90308d989a4ffb90b55ff5d4b4f935'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:37.289948 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf90308d989a4ffb90b55ff5d4b4f935'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:37.303129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf90308d989a4ffb90b55ff5d4b4f935'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:37.382204 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf90308d989a4ffb90b55ff5d4b4f935'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:37.382837 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf90308d989a4ffb90b55ff5d4b4f935'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:37.385230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:37.396541 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1381/2788] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:37 2022] DELETE /identity/v3/users/cf90308d989a4ffb90b55ff5d4b4f935 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:37.400966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:37.401426 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:37.401540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:37.421386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:37.422614 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:37.446758 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:37.481787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1408/2789] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:37.491631 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:37.493034 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:37.550998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d7b6-f17a-4d0d-86b7-bac1eada3da1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:37.554629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:37.555232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:37.555575 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:37.555822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:37.565213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:37.566656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:37.576091 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1382/2790] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:38.018275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:38.019821 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:38.034198 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14dd1a-2ea5-4b6b-9cba-1fbfa9ebdd30 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:38.038859 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:38.039511 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:38.039788 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:38.040060 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] PATH_INFO: `/v3/projects/400613d5fcdc4adeb3cb30413d9a23b2` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:38.041809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400613d5fcdc4adeb3cb30413d9a23b2)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:38.043751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:38.265213 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400613d5fcdc4adeb3cb30413d9a23b2', 'request_id': 'req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.271798 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400613d5fcdc4adeb3cb30413d9a23b2', 'request_id': 'req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.343955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400613d5fcdc4adeb3cb30413d9a23b2', 'request_id': 'req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.354789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] The token cache is being invalidate because project 400613d5fcdc4adeb3cb30413d9a23b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:38.355108 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.355772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.357265 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1409/2791] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:38 2022] DELETE /identity/v3/projects/400613d5fcdc4adeb3cb30413d9a23b2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:38.361827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:38.371711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f9864-f38f-4c39-a2f8-93410ea6f25e service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:38.428813 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:38.429471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:38.429822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:38.430106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] PATH_INFO: `/v3/users/1642a9d6852c42ddae90d9a76efa1979` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:38.431249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1642a9d6852c42ddae90d9a76efa1979)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:38.433191 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:38.683725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1642a9d6852c42ddae90d9a76efa1979'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.684257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1642a9d6852c42ddae90d9a76efa1979'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.696076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1642a9d6852c42ddae90d9a76efa1979'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.789489 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1642a9d6852c42ddae90d9a76efa1979'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.790112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-1f3e92c0-2e5e-46ff-bcad-1e9a90593ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1642a9d6852c42ddae90d9a76efa1979'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:38.802944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1383/2792] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:38 2022] DELETE /identity/v3/users/1642a9d6852c42ddae90d9a76efa1979 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:39.203943 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:39.205419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:39.218491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7e78-2d2d-4c19-8f6f-b5deb3760d05 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:39.278407 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:39.279041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:39.279618 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:39.280010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] PATH_INFO: `/v3/projects/10d93ed77df7466095dd4dace980a82d` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:39.281063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d93ed77df7466095dd4dace980a82d)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:39.283031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:39.399834 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d93ed77df7466095dd4dace980a82d', 'request_id': 'req-12258478-5131-4319-8dd2-2137ad60f8ad'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:39.405980 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d93ed77df7466095dd4dace980a82d', 'request_id': 'req-12258478-5131-4319-8dd2-2137ad60f8ad'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:39.408602 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:39.554058 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d93ed77df7466095dd4dace980a82d', 'request_id': 'req-12258478-5131-4319-8dd2-2137ad60f8ad'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:39.565630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] The token cache is being invalidate because project 10d93ed77df7466095dd4dace980a82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:39.565955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:39.566636 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-12258478-5131-4319-8dd2-2137ad60f8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:39.568156 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1410/2793] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:39 2022] DELETE /identity/v3/projects/10d93ed77df7466095dd4dace980a82d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:39.573120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3991c5-e6de-402e-b4fc-247546c2d526 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:39.573840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3991c5-e6de-402e-b4fc-247546c2d526 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:39.574042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3991c5-e6de-402e-b4fc-247546c2d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:39.594082 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-ea3991c5-e6de-402e-b4fc-247546c2d526 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:39.595270 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-ea3991c5-e6de-402e-b4fc-247546c2d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:39.603603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:39.656031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1384/2794] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:39.664022 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b945-734e-4093-a6ba-daed7ad1a9d7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:39.664310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b945-734e-4093-a6ba-daed7ad1a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:39.664641 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b945-734e-4093-a6ba-daed7ad1a9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:39.685385 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-3e99b945-734e-4093-a6ba-daed7ad1a9d7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:39.686686 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3e99b945-734e-4093-a6ba-daed7ad1a9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:39.694505 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1411/2795] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:39.698730 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3991c5-e6de-402e-b4fc-247546c2d526 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:39.708601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3991c5-e6de-402e-b4fc-247546c2d526 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:39.713424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:39.714020 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:39.714315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:39.714612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:39.715257 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:57:39.715596 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:39.717713 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:39.729604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1385/2796] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:57:39.734608 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b945-734e-4093-a6ba-daed7ad1a9d7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:39.744972 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b945-734e-4093-a6ba-daed7ad1a9d7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:39.748660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:39.749204 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:39.749483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:39.749754 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:39.750388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:39.752322 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:39.858481 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1412/2797] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:39 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:39.862860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:39.872856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedebc6-e47b-4dd6-849f-5830129b67f9 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:39.932994 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:39.933615 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:39.933896 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:39.934167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:39.934797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:39.936981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.190243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1386/2798] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:39 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:40.194366 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.205046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bae9e3-8eb3-4185-8dfb-bf59b2c7b593 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.209703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.210540 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.210813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.211078 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.211889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.213659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.223976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1413/2799] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:40.227905 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.238240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f41ec-1400-49b7-bb31-eefa90cb46ac admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.242726 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b5e5-dfef-4fea-854e-def6b1b039c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.243320 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b5e5-dfef-4fea-854e-def6b1b039c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.243647 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b5e5-dfef-4fea-854e-def6b1b039c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.243922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b5e5-dfef-4fea-854e-def6b1b039c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.244558 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b5e5-dfef-4fea-854e-def6b1b039c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.246161 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b5e5-dfef-4fea-854e-def6b1b039c6 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.256784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1387/2800] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:40.260974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.271467 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323958e4-8887-4a97-9f5e-5d46fd8d1d2e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.275927 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.276561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.276839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.277112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] PATH_INFO: `/v3/projects/efcbd476b4eb4f90b4955c892d8b54ee/users/5fd08fe0498f422cbba25d903103720c/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.298185 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcbd476b4eb4f90b4955c892d8b54ee, user_id=5fd08fe0498f422cbba25d903103720c, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.301012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.403996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1414/2801] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:40 2022] PUT /identity/v3/projects/efcbd476b4eb4f90b4955c892d8b54ee/users/5fd08fe0498f422cbba25d903103720c/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:40.415930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffae9-6884-4ac4-b76c-b74de7bc3eff None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.416287 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffae9-6884-4ac4-b76c-b74de7bc3eff None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.416629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ffae9-6884-4ac4-b76c-b74de7bc3eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.445998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-507ffae9-6884-4ac4-b76c-b74de7bc3eff None None] MFA Rules not processed for user `5fd08fe0498f422cbba25d903103720c`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:40.447214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-507ffae9-6884-4ac4-b76c-b74de7bc3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:40.514930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1388/2802] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:40.519442 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.581048 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643635-83a9-4177-b42b-c4ba62a0edbc admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.585857 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.586455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.586734 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.587004 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.587659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.589573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.688983 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1415/2803] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:40 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:40.693513 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffae9-6884-4ac4-b76c-b74de7bc3eff None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.705581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ffae9-6884-4ac4-b76c-b74de7bc3eff None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.710718 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:40.761710 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.762311 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.762613 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.762882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.763569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.765985 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.830290 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1389/2804] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:40 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:40.834312 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.845800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc527c8f-ae8c-44cb-b128-918efedd96d3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.856196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.856196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.856196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.856196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.856617 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.858774 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.869858 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1416/2805] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:40.874733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.885194 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e573a-0f9f-422d-9225-3be0cf3f01e2 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.890312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4e9dd-1561-4d4e-b493-80c10c8990ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.890929 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e9dd-1561-4d4e-b493-80c10c8990ac admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.891835 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e9dd-1561-4d4e-b493-80c10c8990ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.892116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e9dd-1561-4d4e-b493-80c10c8990ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.893163 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4e9dd-1561-4d4e-b493-80c10c8990ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.894762 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4e9dd-1561-4d4e-b493-80c10c8990ac admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:40.905212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1390/2806] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:40.911099 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:40.925881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf5169-1637-4217-b3c5-85c3e25c6e6b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:40.930899 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:40.931569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:40.931852 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:40.932260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] PATH_INFO: `/v3/projects/cb1cbfa91d5546cf91255ebdcfbd86ce/users/81410a3c3c214451b4464477d97d0771/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:40.947855 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1cbfa91d5546cf91255ebdcfbd86ce, user_id=81410a3c3c214451b4464477d97d0771, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:40.950487 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:41.036598 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1417/2807] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:40 2022] PUT /identity/v3/projects/cb1cbfa91d5546cf91255ebdcfbd86ce/users/81410a3c3c214451b4464477d97d0771/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:41.047437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0164da-1a80-40ee-8b80-dea384f76ec5 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.047785 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0164da-1a80-40ee-8b80-dea384f76ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.048058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0164da-1a80-40ee-8b80-dea384f76ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.076533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-6f0164da-1a80-40ee-8b80-dea384f76ec5 None None] MFA Rules not processed for user `81410a3c3c214451b4464477d97d0771`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:41.077820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-6f0164da-1a80-40ee-8b80-dea384f76ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:41.141242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1391/2808] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:41.145705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:41.178299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:41.208494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f018-88c1-4933-bd32-a704fd1cc43e admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:41.213379 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:41.213974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.214250 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.214521 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.215150 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:41.217781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:41.336593 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1418/2809] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:41 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:41.337816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0164da-1a80-40ee-8b80-dea384f76ec5 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:41.349127 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0164da-1a80-40ee-8b80-dea384f76ec5 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:41.405741 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:41.406279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.406564 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.406840 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.407692 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:41.409601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:41.537682 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1392/2810] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:41 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:41.541724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:41.552928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359c16-b224-415b-97c0-90769b051736 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:41.557539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:41.558131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.558411 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.558683 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.559320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:41.561476 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:41.571233 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1419/2811] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:41.575321 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:41.586297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94b9f3-2d23-4d9a-825f-350647e9f32c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:41.591079 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:41.592460 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.592773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.593188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] PATH_INFO: `/v3/projects/589c21d20e694abd82d29876132cfe5b/users/454e29888d58494fa9e577686a9189c4/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.595775 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:41.609234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589c21d20e694abd82d29876132cfe5b, user_id=454e29888d58494fa9e577686a9189c4, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:41.612057 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:41.682111 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1393/2812] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:41 2022] PUT /identity/v3/projects/589c21d20e694abd82d29876132cfe5b/users/454e29888d58494fa9e577686a9189c4/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:41.686354 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:41.696785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26b8e-1148-402d-8dc0-177372557d37 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:41.752966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9559aa5-1a1e-4346-93d5-d0c7c97b8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:41.753562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559aa5-1a1e-4346-93d5-d0c7c97b8ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.753839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559aa5-1a1e-4346-93d5-d0c7c97b8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.754110 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9559aa5-1a1e-4346-93d5-d0c7c97b8ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.754786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9559aa5-1a1e-4346-93d5-d0c7c97b8ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:41.756386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9559aa5-1a1e-4346-93d5-d0c7c97b8ec8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:41.766584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1420/2813] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:41.770987 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:41.781737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415306-6829-4fc1-b7f8-6d3427da0d54 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:41.786878 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:41.787569 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.787848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.788122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] PATH_INFO: `/v3/projects/589c21d20e694abd82d29876132cfe5b/users/454e29888d58494fa9e577686a9189c4/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.790002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589c21d20e694abd82d29876132cfe5b, user_id=454e29888d58494fa9e577686a9189c4, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:41.792732 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:41.803154 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1394/2814] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:41 2022] PUT /identity/v3/projects/589c21d20e694abd82d29876132cfe5b/users/454e29888d58494fa9e577686a9189c4/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:41.813850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a03d2-813c-4405-a0c9-ccb2bf20cf5d None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.814142 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a03d2-813c-4405-a0c9-ccb2bf20cf5d None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.814418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a03d2-813c-4405-a0c9-ccb2bf20cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:41.843273 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-174a03d2-813c-4405-a0c9-ccb2bf20cf5d None None] MFA Rules not processed for user `454e29888d58494fa9e577686a9189c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:41.844500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-174a03d2-813c-4405-a0c9-ccb2bf20cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:41.911128 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1421/2815] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:41.922826 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:41.924820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:41.985151 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971799f-4906-466d-ae0d-7289a6751b95 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:41.989299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:41.989926 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:41.990200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:41.990477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:42.051685 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:42.054058 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:42.064001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1395/2816] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:44.129992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a03d2-813c-4405-a0c9-ccb2bf20cf5d None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:44.140197 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a03d2-813c-4405-a0c9-ccb2bf20cf5d None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:44.143800 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:44.144394 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:44.144673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:44.144946 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:44.166104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:44.203929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:44.205383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:44.214280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1422/2817] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:45.763758 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:45.772209 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d908f-ed3d-4105-9286-ed3315452d77 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:45.775846 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4ab2-de43-45bf-a1cd-0d7be2d207ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:45.776441 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4ab2-de43-45bf-a1cd-0d7be2d207ce service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:45.779807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4ab2-de43-45bf-a1cd-0d7be2d207ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:45.779807 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4ab2-de43-45bf-a1cd-0d7be2d207ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:45.786725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd4ab2-de43-45bf-a1cd-0d7be2d207ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:45.788353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd4ab2-de43-45bf-a1cd-0d7be2d207ce service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:45.798548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1396/2818] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:50.382604 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:50.449634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806e4da-b8bd-41a9-973a-a781c7c485a2 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:50.455832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:50.456468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:50.456781 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:50.457059 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] PATH_INFO: `/v3/users/5fd08fe0498f422cbba25d903103720c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:50.458189 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd08fe0498f422cbba25d903103720c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:50.460421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:50.674222 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd08fe0498f422cbba25d903103720c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:50.675126 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd08fe0498f422cbba25d903103720c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:50.687796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd08fe0498f422cbba25d903103720c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:50.755112 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd08fe0498f422cbba25d903103720c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:50.755750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd08fe0498f422cbba25d903103720c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:50.769310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1423/2819] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:50 2022] DELETE /identity/v3/users/5fd08fe0498f422cbba25d903103720c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:50.774028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:50.774492 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:50.774614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:50.794143 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:50.795315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:50.853744 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1397/2820] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:50.863906 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:50.865317 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:50.910640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:50.924528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af505bb9-1881-4f51-b62d-573bd83e5500 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:50.928280 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:50.928888 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:50.929164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:50.929438 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:50.939266 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:50.940871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:50.950245 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1424/2821] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:51.340561 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:51.342012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:51.354414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3aab2-32dd-4f58-909f-b44d46425c80 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:51.359011 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:51.359697 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:51.359972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:51.360238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] PATH_INFO: `/v3/projects/efcbd476b4eb4f90b4955c892d8b54ee` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:51.361343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcbd476b4eb4f90b4955c892d8b54ee)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:51.363264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:51.370339 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:51.459071 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcbd476b4eb4f90b4955c892d8b54ee', 'request_id': 'req-8fea9a26-3201-4255-9519-21277f35537c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.465230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcbd476b4eb4f90b4955c892d8b54ee', 'request_id': 'req-8fea9a26-3201-4255-9519-21277f35537c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.544061 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcbd476b4eb4f90b4955c892d8b54ee', 'request_id': 'req-8fea9a26-3201-4255-9519-21277f35537c'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.554750 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] The token cache is being invalidate because project efcbd476b4eb4f90b4955c892d8b54ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:51.555293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.556517 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.561637 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1398/2822] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:51 2022] DELETE /identity/v3/projects/efcbd476b4eb4f90b4955c892d8b54ee => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:51.562194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:51.571843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794bf1-4691-4665-8d3e-550dfc457e1b service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:51.629348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:51.629974 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:51.630246 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:51.630544 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] PATH_INFO: `/v3/users/81410a3c3c214451b4464477d97d0771` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:51.631746 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81410a3c3c214451b4464477d97d0771)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:51.633775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:51.802326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81410a3c3c214451b4464477d97d0771'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.803144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81410a3c3c214451b4464477d97d0771'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.815761 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81410a3c3c214451b4464477d97d0771'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.876104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81410a3c3c214451b4464477d97d0771'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.876792 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81410a3c3c214451b4464477d97d0771'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:51.890194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1425/2823] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:51 2022] DELETE /identity/v3/users/81410a3c3c214451b4464477d97d0771 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:52.328993 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:52.330424 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:52.351995 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9a26-3201-4255-9519-21277f35537c admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:52.415232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:52.415953 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:52.416301 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:52.416642 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] PATH_INFO: `/v3/projects/cb1cbfa91d5546cf91255ebdcfbd86ce` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:52.417822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1cbfa91d5546cf91255ebdcfbd86ce)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:52.419845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:52.554914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1cbfa91d5546cf91255ebdcfbd86ce', 'request_id': 'req-76333ba2-1417-4653-8dc1-00efee903e5f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:52.561276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1cbfa91d5546cf91255ebdcfbd86ce', 'request_id': 'req-76333ba2-1417-4653-8dc1-00efee903e5f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:52.647022 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1cbfa91d5546cf91255ebdcfbd86ce', 'request_id': 'req-76333ba2-1417-4653-8dc1-00efee903e5f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:52.658709 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] The token cache is being invalidate because project cb1cbfa91d5546cf91255ebdcfbd86ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:52.659002 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:52.659676 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:52.661251 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1399/2824] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:52 2022] DELETE /identity/v3/projects/cb1cbfa91d5546cf91255ebdcfbd86ce => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:52.665513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:52.667692 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:52.680655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20891a-6008-4958-b232-d2f8bb7e4817 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:52.739996 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:52.740630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:52.740960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:52.741182 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] PATH_INFO: `/v3/users/454e29888d58494fa9e577686a9189c4` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:52.742303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454e29888d58494fa9e577686a9189c4)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:52.744276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:52.748989 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:52.975029 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454e29888d58494fa9e577686a9189c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:52.975716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454e29888d58494fa9e577686a9189c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:52.988082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454e29888d58494fa9e577686a9189c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.003622 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:53.005091 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:53.018333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76333ba2-1417-4653-8dc1-00efee903e5f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:53.023090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:53.023797 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:53.024077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:53.024353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] PATH_INFO: `/v3/users/11f733938ca54d10b3cd55aef17af329` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:53.025480 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f733938ca54d10b3cd55aef17af329)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:53.027485 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:53.049983 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:53.098242 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454e29888d58494fa9e577686a9189c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.098854 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454e29888d58494fa9e577686a9189c4'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.112326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1426/2825] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:52 2022] DELETE /identity/v3/users/454e29888d58494fa9e577686a9189c4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:53.304609 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f733938ca54d10b3cd55aef17af329'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.305267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f733938ca54d10b3cd55aef17af329'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.318227 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f733938ca54d10b3cd55aef17af329'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.390300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f733938ca54d10b3cd55aef17af329'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.391778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f733938ca54d10b3cd55aef17af329'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.404670 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1400/2826] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:53 2022] DELETE /identity/v3/users/11f733938ca54d10b3cd55aef17af329 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:53.557098 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:53.558843 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:53.628577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b030ad-0ceb-49e5-95a3-ca9c35e939f3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:53.689181 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:53.690117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:53.690828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:53.691240 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:53.691373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:53.691373 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] PATH_INFO: `/v3/projects/589c21d20e694abd82d29876132cfe5b` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:53.692532 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589c21d20e694abd82d29876132cfe5b)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:53.694444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:53.707523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f89f2-467b-4e4e-8dd9-ad3739b54bd7 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:53.712660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:53.713300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:53.713581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:53.713856 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] PATH_INFO: `/v3/projects/ccb517420aca4ffe97b17e355babaeca` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:53.715187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb517420aca4ffe97b17e355babaeca)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:53.717140 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:53.795748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:53.807370 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589c21d20e694abd82d29876132cfe5b', 'request_id': 'req-9bf48a18-464a-48ef-956e-b4d254273946'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.814589 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589c21d20e694abd82d29876132cfe5b', 'request_id': 'req-9bf48a18-464a-48ef-956e-b4d254273946'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.830658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb517420aca4ffe97b17e355babaeca', 'request_id': 'req-093d3538-1e5b-4d70-8753-20824139fdfb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.837136 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb517420aca4ffe97b17e355babaeca', 'request_id': 'req-093d3538-1e5b-4d70-8753-20824139fdfb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.904196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589c21d20e694abd82d29876132cfe5b', 'request_id': 'req-9bf48a18-464a-48ef-956e-b4d254273946'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.916680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] The token cache is being invalidate because project 589c21d20e694abd82d29876132cfe5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:53.916970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.917680 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-9bf48a18-464a-48ef-956e-b4d254273946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:53.919163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1427/2827] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:53 2022] DELETE /identity/v3/projects/589c21d20e694abd82d29876132cfe5b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:53.923867 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:53.924149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:53.924419 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:53.944155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:53.950275 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:53.993174 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb517420aca4ffe97b17e355babaeca', 'request_id': 'req-093d3538-1e5b-4d70-8753-20824139fdfb'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.005113 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] The token cache is being invalidate because project ccb517420aca4ffe97b17e355babaeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:54.005407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.006074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-093d3538-1e5b-4d70-8753-20824139fdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.006914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1428/2828] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:54.007581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1401/2829] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:53 2022] DELETE /identity/v3/projects/ccb517420aca4ffe97b17e355babaeca => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:54.011371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.012711 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:54.023791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c631e92-321e-492a-9c64-0b604c2c1ab8 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.024076 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c631e92-321e-492a-9c64-0b604c2c1ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.024348 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c631e92-321e-492a-9c64-0b604c2c1ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.024954 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6152fe-eeb3-41c8-86b7-9b647b7aa7e9 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.029737 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.030555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.030665 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.030929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] PATH_INFO: `/v3/users/f7624703826d443698f79b3f9d5a25d9` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.032088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7624703826d443698f79b3f9d5a25d9)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.034046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.054351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-3c631e92-321e-492a-9c64-0b604c2c1ab8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:54.055638 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3c631e92-321e-492a-9c64-0b604c2c1ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:54.064842 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1402/2830] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:54.069359 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c631e92-321e-492a-9c64-0b604c2c1ab8 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.079774 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c631e92-321e-492a-9c64-0b604c2c1ab8 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.084811 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.085471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.085754 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.086025 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.086763 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:57:54.087077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.088717 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.101303 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1403/2831] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:57:54.105723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.115578 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564f419-fc9a-4108-9e8d-bde5f8351f84 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.120371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.120964 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.121244 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.121548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.122129 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.124198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.236924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1404/2832] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:54 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:54.240935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.267753 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7624703826d443698f79b3f9d5a25d9'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.268415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7624703826d443698f79b3f9d5a25d9'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.281562 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7624703826d443698f79b3f9d5a25d9'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.286612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:54.314012 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcf66f-dfdf-4793-a3a2-eac00df5b379 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.319500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.320122 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.320407 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.320683 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.321350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.323261 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.399015 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7624703826d443698f79b3f9d5a25d9'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.399663 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7624703826d443698f79b3f9d5a25d9'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.412482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1429/2833] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:54 2022] DELETE /identity/v3/users/f7624703826d443698f79b3f9d5a25d9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:54.432084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1405/2834] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:54 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:54.433696 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.435071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:54.476805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:54.506802 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af884-d343-4ca7-a9f4-ab44f6299cb0 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.511567 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.512211 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.512482 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.512750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.513386 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.514961 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.525075 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1430/2835] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:54.529280 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.540548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0f948-15bc-4a01-a82d-4b605150b8a8 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.545300 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.546001 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.546357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.546703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.548648 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.550313 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.560783 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1406/2836] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:54.565832 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.575945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a94e-6c7b-48ce-84d6-70417da93872 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.581470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957a65a-59d0-42da-809d-f53e5591215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.581470 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957a65a-59d0-42da-809d-f53e5591215b admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.581694 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957a65a-59d0-42da-809d-f53e5591215b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.581868 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957a65a-59d0-42da-809d-f53e5591215b admin admin] PATH_INFO: `/v3/projects/b4402f84699e43eb948968cf5b8be84b/users/af2c8fa51a9e4492ad39e7e90d856e8b/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.597496 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957a65a-59d0-42da-809d-f53e5591215b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4402f84699e43eb948968cf5b8be84b, user_id=af2c8fa51a9e4492ad39e7e90d856e8b, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.600301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957a65a-59d0-42da-809d-f53e5591215b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.683065 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.685120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:54.691629 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1431/2837] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:54 2022] PUT /identity/v3/projects/b4402f84699e43eb948968cf5b8be84b/users/af2c8fa51a9e4492ad39e7e90d856e8b/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:54.705374 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fce73-96fb-4c80-b9e0-2c5f82501465 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.705795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fce73-96fb-4c80-b9e0-2c5f82501465 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.706310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fce73-96fb-4c80-b9e0-2c5f82501465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.709150 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109521-a57a-4ef9-8df8-ec0d5d725f38 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.737104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-148fce73-96fb-4c80-b9e0-2c5f82501465 None None] MFA Rules not processed for user `af2c8fa51a9e4492ad39e7e90d856e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:54.738463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-148fce73-96fb-4c80-b9e0-2c5f82501465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:54.770242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.770881 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.771160 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.771442 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] PATH_INFO: `/v3/projects/054fd78982bd4b7e9acaa991ad990424` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.772592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054fd78982bd4b7e9acaa991ad990424)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.774470 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.805039 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1432/2838] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:54.809785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fce73-96fb-4c80-b9e0-2c5f82501465 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.820206 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fce73-96fb-4c80-b9e0-2c5f82501465 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.824785 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.828149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.828149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.828149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.828149 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:54.828572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:54.866027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054fd78982bd4b7e9acaa991ad990424', 'request_id': 'req-d454b531-6e2f-47dc-a3b4-af423fdd5594'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.872326 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054fd78982bd4b7e9acaa991ad990424', 'request_id': 'req-d454b531-6e2f-47dc-a3b4-af423fdd5594'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.915569 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1433/2839] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:54 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:54.919461 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:54.930507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054fd78982bd4b7e9acaa991ad990424', 'request_id': 'req-d454b531-6e2f-47dc-a3b4-af423fdd5594'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.942232 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] The token cache is being invalidate because project 054fd78982bd4b7e9acaa991ad990424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:57:54.942605 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.943253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-d454b531-6e2f-47dc-a3b4-af423fdd5594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:57:54.944880 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1407/2840] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:57:54 2022] DELETE /identity/v3/projects/054fd78982bd4b7e9acaa991ad990424 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:54.949559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25714-f52b-4541-a036-c91e372990f4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.949854 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25714-f52b-4541-a036-c91e372990f4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.950128 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e25714-f52b-4541-a036-c91e372990f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.970537 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-89e25714-f52b-4541-a036-c91e372990f4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:54.971777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-89e25714-f52b-4541-a036-c91e372990f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:54.991659 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839224c-e9b8-4f9d-9395-f8bff413a748 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:54.996363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:54.996963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:54.997241 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:54.997533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:54.998215 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.000177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.015200 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:55.033764 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1408/2841] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:55.041087 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01f399-46d2-4802-a8f2-95311bb30a26 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.041374 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01f399-46d2-4802-a8f2-95311bb30a26 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.041649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01f399-46d2-4802-a8f2-95311bb30a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.060604 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-5a01f399-46d2-4802-a8f2-95311bb30a26 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:55.061792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5a01f399-46d2-4802-a8f2-95311bb30a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:55.070848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1434/2842] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:54 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:55.071074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1409/2843] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:55.072339 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.073939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:55.078188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01f399-46d2-4802-a8f2-95311bb30a26 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.081713 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:55.087578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e890a-4dd4-4bd4-851d-3cec533f3c8a admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.088072 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01f399-46d2-4802-a8f2-95311bb30a26 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.092480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.092776 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.093184 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.093406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.093513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.093688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.093795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.094883 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.095007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.095701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:57:55.098427 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.098674 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.098777 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.107327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1435/2844] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:55.114021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1410/2845] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 28 08:57:55.114160 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.114960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.121291 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086853-ffa9-4d0a-8042-9a0eb4a66bd3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.125414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621aad5a-56c8-4506-bd1b-01e245af51e1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.126139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.126760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.127038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.127310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.128005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.129722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.130230 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.130812 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.131090 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.131361 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.132016 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.133886 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.141307 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1436/2846] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:55.145104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.157177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5808-7293-4c5d-8b79-6f9c93eb1bc3 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.160455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b62e8-96d1-4654-901d-8a762dd544e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.161096 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b62e8-96d1-4654-901d-8a762dd544e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.161377 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b62e8-96d1-4654-901d-8a762dd544e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.161681 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b62e8-96d1-4654-901d-8a762dd544e6 admin admin] PATH_INFO: `/v3/projects/00677dec049b46c79f92e21b855ec9b6/users/316e8a995eec4c01adb22629aca690d2/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.175912 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b62e8-96d1-4654-901d-8a762dd544e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00677dec049b46c79f92e21b855ec9b6, user_id=316e8a995eec4c01adb22629aca690d2, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.178578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b62e8-96d1-4654-901d-8a762dd544e6 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.269617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1411/2847] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:57:55.273658 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.280375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1437/2848] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:55 2022] PUT /identity/v3/projects/00677dec049b46c79f92e21b855ec9b6/users/316e8a995eec4c01adb22629aca690d2/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:55.292100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6585f7-515d-4597-8dc0-d8da34174ddd None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.292456 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6585f7-515d-4597-8dc0-d8da34174ddd None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.292795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6585f7-515d-4597-8dc0-d8da34174ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.320966 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-fb6585f7-515d-4597-8dc0-d8da34174ddd None None] MFA Rules not processed for user `316e8a995eec4c01adb22629aca690d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:55.322168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-fb6585f7-515d-4597-8dc0-d8da34174ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:55.354237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82285bb7-1180-4b64-abaf-10321468d1a3 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.388848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1438/2849] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:55.393331 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6585f7-515d-4597-8dc0-d8da34174ddd None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.417043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.417690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.417937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.418210 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.418836 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.420768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.459968 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6585f7-515d-4597-8dc0-d8da34174ddd None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.464783 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.465388 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.465666 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.465936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.466558 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.468480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.530474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1412/2850] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:55.535203 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.544696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8cc4-3c49-4885-bf54-1ac6a3959bbe admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.549600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.550173 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.550450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.550720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.551402 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.553043 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.563299 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1413/2851] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:55.571858 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.575107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1439/2852] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:55.579579 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.582818 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48065f-1525-4e51-ab6c-16f6ea28cae0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.617390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:55.619829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:55.647014 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.647660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.647942 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.648220 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.648786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6d6b3-a810-4718-938a-9cfef86d9471 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.648922 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.650808 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.653472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.658500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.658500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.658500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.658500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.658500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.665481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1414/2853] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:55.666312 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.676007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ddfd1-a206-4106-8e33-c3572441ab2b admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.680673 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71a30-d147-4bbf-82b6-e12a9ccfce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.681398 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71a30-d147-4bbf-82b6-e12a9ccfce22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.681587 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71a30-d147-4bbf-82b6-e12a9ccfce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.681860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71a30-d147-4bbf-82b6-e12a9ccfce22 admin admin] PATH_INFO: `/v3/projects/d81da491d3eb42bbb9424cf192f8cdb0/users/9456c88a16e24dbfaf9bbd071aeef0f4/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.697981 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad71a30-d147-4bbf-82b6-e12a9ccfce22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81da491d3eb42bbb9424cf192f8cdb0, user_id=9456c88a16e24dbfaf9bbd071aeef0f4, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.700728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad71a30-d147-4bbf-82b6-e12a9ccfce22 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.727343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1440/2854] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:55.730958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.741634 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef331-bc78-4665-98c7-bcb8e40a6cc8 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.746421 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.747005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.747287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.747627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.748252 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.749848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.760796 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1441/2855] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:55.764784 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.774597 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cbac6-9a03-4e2d-8786-a1682148dd9b admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.779502 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.780196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.780472 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.780743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] PATH_INFO: `/v3/projects/d7c91c2ab6f5434c83b7a7a720ea21d9/users/54d1af42945849778922358cb4b30956/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.787903 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1415/2856] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:55 2022] PUT /identity/v3/projects/d81da491d3eb42bbb9424cf192f8cdb0/users/9456c88a16e24dbfaf9bbd071aeef0f4/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:55.796723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c91c2ab6f5434c83b7a7a720ea21d9, user_id=54d1af42945849778922358cb4b30956, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.799897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a5810-896c-4345-bb59-aebecb4773a2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.800192 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a5810-896c-4345-bb59-aebecb4773a2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.800332 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.800476 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a5810-896c-4345-bb59-aebecb4773a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.829471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-192a5810-896c-4345-bb59-aebecb4773a2 None None] MFA Rules not processed for user `9456c88a16e24dbfaf9bbd071aeef0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:55.830619 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-192a5810-896c-4345-bb59-aebecb4773a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:55.896494 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1442/2857] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:55 2022] PUT /identity/v3/projects/d7c91c2ab6f5434c83b7a7a720ea21d9/users/54d1af42945849778922358cb4b30956/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:55.897543 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1416/2858] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:55.900930 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.901834 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a5810-896c-4345-bb59-aebecb4773a2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:55.966391 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a5810-896c-4345-bb59-aebecb4773a2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.966967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b503-79b1-44b6-998d-0844b6466734 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:55.971302 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.971935 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.972090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:55.972234 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.972471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.972698 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:55.973011 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:55.973125 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.973352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:55.973999 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:55.974963 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.975633 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:55.987640 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1443/2859] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:55.991952 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.002406 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d329ff7-17c6-4efd-b5a9-4552136a1461 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.006976 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558efd6-70a3-4ef5-966b-87977cd34863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.007643 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558efd6-70a3-4ef5-966b-87977cd34863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.007922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558efd6-70a3-4ef5-966b-87977cd34863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.008196 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558efd6-70a3-4ef5-966b-87977cd34863 admin admin] PATH_INFO: `/v3/projects/d7c91c2ab6f5434c83b7a7a720ea21d9/users/54d1af42945849778922358cb4b30956/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.010094 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558efd6-70a3-4ef5-966b-87977cd34863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c91c2ab6f5434c83b7a7a720ea21d9, user_id=54d1af42945849778922358cb4b30956, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.012771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558efd6-70a3-4ef5-966b-87977cd34863 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.023158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1444/2860] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:55 2022] PUT /identity/v3/projects/d7c91c2ab6f5434c83b7a7a720ea21d9/users/54d1af42945849778922358cb4b30956/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 28 08:57:56.034981 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.035257 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.035560 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.053821 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1417/2861] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:56.064907 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] MFA Rules not processed for user `54d1af42945849778922358cb4b30956`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:56.065063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.066117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:56.086318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:56.125992 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:56.129457 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2aca61-bceb-4152-ac91-65f902eff2e1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.134282 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.134879 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.135157 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.135475 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.135747 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1445/2862] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 28 08:57:56.136207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.138383 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.147300 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.148722 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:56.204920 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1458375-e89f-4987-84bb-dbe21d9c8ab4 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.208533 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.209169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.209448 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.209993 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.211829 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:56.251281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1418/2863] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:57:56 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:57:56.259806 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.269763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.270152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5f24-5aee-4f4c-bfdd-1dad14b79482 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.271230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.274860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.275474 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.275768 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.276036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.276674 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.278238 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.280477 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1446/2864] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:57:56.288894 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1419/2865] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 28 08:57:56.292947 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.304616 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd262a0b-c6ac-4ead-8df7-9997a220fb92 service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.309378 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.310023 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.310310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.310584 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] PATH_INFO: `/v3/projects/3811c539b84549c0bb97897046e1c7f2/users/d614693d40554f75979c4ede478d2ed0/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.326445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3811c539b84549c0bb97897046e1c7f2, user_id=d614693d40554f75979c4ede478d2ed0, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.329787 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.396478 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1447/2866] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:56 2022] PUT /identity/v3/projects/3811c539b84549c0bb97897046e1c7f2/users/d614693d40554f75979c4ede478d2ed0/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:56.400243 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.410527 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c173b-e213-4ec8-99e3-bd9496a16777 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.467961 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06c47f-4428-4e69-a73e-8ccd0fef2320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.468570 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06c47f-4428-4e69-a73e-8ccd0fef2320 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.468884 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06c47f-4428-4e69-a73e-8ccd0fef2320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.469393 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06c47f-4428-4e69-a73e-8ccd0fef2320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.470167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06c47f-4428-4e69-a73e-8ccd0fef2320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.471787 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06c47f-4428-4e69-a73e-8ccd0fef2320 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.481477 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1420/2867] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:57:56.486382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.496572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a1884-f43f-4768-902e-0bfd62b5f833 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.501725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.502368 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.502645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.502917 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] PATH_INFO: `/v3/projects/3811c539b84549c0bb97897046e1c7f2/users/d614693d40554f75979c4ede478d2ed0/roles/8b22e1c1112547309cda07f916d1a452` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.504877 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3811c539b84549c0bb97897046e1c7f2, user_id=d614693d40554f75979c4ede478d2ed0, role_id=8b22e1c1112547309cda07f916d1a452)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.507517 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.517750 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1448/2868] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:57:56 2022] PUT /identity/v3/projects/3811c539b84549c0bb97897046e1c7f2/users/d614693d40554f75979c4ede478d2ed0/roles/8b22e1c1112547309cda07f916d1a452 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:57:56.527707 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f98e6-bb1b-4ccd-913f-719dd996a857 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.527997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f98e6-bb1b-4ccd-913f-719dd996a857 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.528277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f98e6-bb1b-4ccd-913f-719dd996a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.556389 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-8f9f98e6-bb1b-4ccd-913f-719dd996a857 None None] MFA Rules not processed for user `d614693d40554f75979c4ede478d2ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:57:56.557601 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-8f9f98e6-bb1b-4ccd-913f-719dd996a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:56.629418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1421/2869] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:57:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:57:56.640169 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:56.642168 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:57:56.703121 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebcd97-9ad6-454f-9aa4-654c7c6cbd7d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:56.706803 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:56.707413 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:56.707743 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:56.708017 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:56.732205 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:56.765129 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:56.766751 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:56.775655 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1449/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:58.237371 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f98e6-bb1b-4ccd-913f-719dd996a857 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:58.246855 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f98e6-bb1b-4ccd-913f-719dd996a857 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:58.250372 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:58.250969 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:58.251967 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:58.252246 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:58.264944 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:57:58.308633 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:58.310053 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:58.319784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1422/2871] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:59.761159 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:59.770660 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8865b-9ff9-4a4b-bcd2-f61296c1e48e service cinder] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:59.774337 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69507ba9-2c38-4fac-978a-c860cb3eeca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:59.774928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69507ba9-2c38-4fac-978a-c860cb3eeca7 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:59.775209 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69507ba9-2c38-4fac-978a-c860cb3eeca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:59.775518 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69507ba9-2c38-4fac-978a-c860cb3eeca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:59.837627 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69507ba9-2c38-4fac-978a-c860cb3eeca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:59.839051 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69507ba9-2c38-4fac-978a-c860cb3eeca7 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:57:59.849074 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1450/2872] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:57:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:57:59.870979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:57:59.935863 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38eba-7b32-4b18-b32c-c7b6be60ebef service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:57:59.941120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:57:59.941749 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:57:59.942031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:57:59.943660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] PATH_INFO: `/v3/users/9456c88a16e24dbfaf9bbd071aeef0f4` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:57:59.943660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9456c88a16e24dbfaf9bbd071aeef0f4)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:57:59.945414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:00.128723 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9456c88a16e24dbfaf9bbd071aeef0f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:00.129310 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9456c88a16e24dbfaf9bbd071aeef0f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:00.141126 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9456c88a16e24dbfaf9bbd071aeef0f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:00.204997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9456c88a16e24dbfaf9bbd071aeef0f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:00.205625 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9456c88a16e24dbfaf9bbd071aeef0f4'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:00.218281 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1423/2873] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:57:59 2022] DELETE /identity/v3/users/9456c88a16e24dbfaf9bbd071aeef0f4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:00.222971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:00.223260 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:00.223587 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:00.244147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:00.245326 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:00.304804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1451/2874] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:00.315226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:00.316728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:00.356700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:00.373369 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc630e1-2ecd-4808-9fcb-2aab7c83fcdf admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:00.377584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:00.378187 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:00.378466 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:00.378791 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:00.387661 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:00.389081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:00.399555 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1424/2875] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 28 08:58:00.883652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:00.883652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:00.899718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e269b-1d88-4022-be82-0a3dcc2b80b8 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:00.905095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:00.905723 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:00.905997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:00.906269 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] PATH_INFO: `/v3/projects/d81da491d3eb42bbb9424cf192f8cdb0` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:00.907559 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81da491d3eb42bbb9424cf192f8cdb0)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:00.909503 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:01.002117 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81da491d3eb42bbb9424cf192f8cdb0', 'request_id': 'req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.008155 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81da491d3eb42bbb9424cf192f8cdb0', 'request_id': 'req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.009794 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:01.064444 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81da491d3eb42bbb9424cf192f8cdb0', 'request_id': 'req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.074939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] The token cache is being invalidate because project d81da491d3eb42bbb9424cf192f8cdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:58:01.075224 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.075884 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.077372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1452/2876] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:58:00 2022] DELETE /identity/v3/projects/d81da491d3eb42bbb9424cf192f8cdb0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:01.081499 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:01.091357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a765-3e3a-4840-9af7-c57e3fd1f4ca service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:01.149831 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:01.150778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:01.150778 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:01.151121 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] PATH_INFO: `/v3/users/d614693d40554f75979c4ede478d2ed0` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:01.152186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d614693d40554f75979c4ede478d2ed0)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:01.154088 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:01.406733 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd614693d40554f75979c4ede478d2ed0'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.407293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd614693d40554f75979c4ede478d2ed0'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.419077 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd614693d40554f75979c4ede478d2ed0'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.532528 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd614693d40554f75979c4ede478d2ed0'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.533146 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-260846ab-9b2c-4dc4-9a03-5e541224f79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd614693d40554f75979c4ede478d2ed0'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:01.545629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1425/2877] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:58:01 2022] DELETE /identity/v3/users/d614693d40554f75979c4ede478d2ed0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:01.968551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:01.970026 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:01.983645 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bae7c-2e22-4cb5-a3b0-1bb53b11c98c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:02.042310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:02.042935 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.043212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.043520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] PATH_INFO: `/v3/projects/3811c539b84549c0bb97897046e1c7f2` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.044612 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3811c539b84549c0bb97897046e1c7f2)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:02.046489 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:02.155359 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3811c539b84549c0bb97897046e1c7f2', 'request_id': 'req-0d60151a-e7dc-48a5-9ad7-020417a29e83'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:02.161506 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3811c539b84549c0bb97897046e1c7f2', 'request_id': 'req-0d60151a-e7dc-48a5-9ad7-020417a29e83'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:02.238384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3811c539b84549c0bb97897046e1c7f2', 'request_id': 'req-0d60151a-e7dc-48a5-9ad7-020417a29e83'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:02.248997 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] The token cache is being invalidate because project 3811c539b84549c0bb97897046e1c7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:58:02.249287 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:02.249914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-0d60151a-e7dc-48a5-9ad7-020417a29e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:02.251400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1453/2878] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:58:01 2022] DELETE /identity/v3/projects/3811c539b84549c0bb97897046e1c7f2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:02.256861 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656b5fe-b753-492a-82bc-210370237ca3 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.257318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656b5fe-b753-492a-82bc-210370237ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.257418 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656b5fe-b753-492a-82bc-210370237ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.277649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c656b5fe-b753-492a-82bc-210370237ca3 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:02.278843 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c656b5fe-b753-492a-82bc-210370237ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:02.328816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:02.338925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1426/2879] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:02.347457 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453e89d-d231-4041-b232-c38e9b9ed121 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.347738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453e89d-d231-4041-b232-c38e9b9ed121 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.348012 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453e89d-d231-4041-b232-c38e9b9ed121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.367341 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8453e89d-d231-4041-b232-c38e9b9ed121 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:02.368646 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8453e89d-d231-4041-b232-c38e9b9ed121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:02.376500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1454/2880] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:02.380895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656b5fe-b753-492a-82bc-210370237ca3 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:02.390414 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656b5fe-b753-492a-82bc-210370237ca3 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:02.395827 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:02.396450 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.396735 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.397021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.397675 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:58:02.397979 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:02.399690 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:02.411918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1427/2881] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:58:02.416139 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453e89d-d231-4041-b232-c38e9b9ed121 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:02.426077 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453e89d-d231-4041-b232-c38e9b9ed121 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:02.430620 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:02.431208 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.431520 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.431795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.432434 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:02.434336 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:02.617491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1455/2882] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:58:02 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:58:02.620493 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:02.630577 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27db05d-e822-4db8-9acf-3010d229e984 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:02.688616 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:02.689212 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.689491 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.689824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.690559 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:02.692488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:02.763725 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1428/2883] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:58:02 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:58:02.767801 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:02.778365 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3388890-1b8a-43ab-b93c-869c303517cf admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:02.782813 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:02.784007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.784483 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.785034 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.786194 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:02.788486 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:02.802375 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1456/2884] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:58:02.803931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:02.813885 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38950-4637-43b8-87a2-d5e075fd2bfc admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:02.818780 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74541db-e621-4fbe-89f7-51d85e46d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:02.819378 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74541db-e621-4fbe-89f7-51d85e46d948 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.819696 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74541db-e621-4fbe-89f7-51d85e46d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.819968 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74541db-e621-4fbe-89f7-51d85e46d948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.820602 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74541db-e621-4fbe-89f7-51d85e46d948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:02.822145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74541db-e621-4fbe-89f7-51d85e46d948 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:02.833702 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1429/2885] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:58:02.837897 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:02.849042 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e1b6-717e-4fdd-b662-cb9bdedf8a1d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:02.853735 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:02.854384 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.854664 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:02.854967 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] PATH_INFO: `/v3/projects/b70b3ec9308e405289877ebbce0404c5/users/9f8169022e17425cbe5d57afd1e3fe13/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:02.869827 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70b3ec9308e405289877ebbce0404c5, user_id=9f8169022e17425cbe5d57afd1e3fe13, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:02.872449 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:02.988088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1457/2886] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:58:02 2022] PUT /identity/v3/projects/b70b3ec9308e405289877ebbce0404c5/users/9f8169022e17425cbe5d57afd1e3fe13/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:02.999502 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:02.999816 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:03.000096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:03.028501 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] MFA Rules not processed for user `9f8169022e17425cbe5d57afd1e3fe13`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:03.029701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:03.098036 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1430/2887] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:03.109392 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:03.111179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:03.122082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:03.167529 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b2fb3-3ab5-47cc-8f70-82ca48d5e923 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:03.171090 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3180e5-8d2c-4e8f-b1e7-b92328778f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:03.171716 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3180e5-8d2c-4e8f-b1e7-b92328778f65 service cinder] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:03.171998 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3180e5-8d2c-4e8f-b1e7-b92328778f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:03.172286 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3180e5-8d2c-4e8f-b1e7-b92328778f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:03.180749 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3180e5-8d2c-4e8f-b1e7-b92328778f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:03.182181 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3180e5-8d2c-4e8f-b1e7-b92328778f65 service cinder] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:03.191898 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1458/2888] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:04.667446 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:04.670943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:04.722727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:04.734924 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb10a-94ac-42cf-ba5b-e3b1c6a2c86c None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:04.740056 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:04.740649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:04.740928 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:04.741198 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] PATH_INFO: `/v3/users/af2c8fa51a9e4492ad39e7e90d856e8b` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:04.742292 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2c8fa51a9e4492ad39e7e90d856e8b)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:04.744249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:04.978766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2c8fa51a9e4492ad39e7e90d856e8b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:04.979410 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2c8fa51a9e4492ad39e7e90d856e8b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:04.995458 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2c8fa51a9e4492ad39e7e90d856e8b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:05.050877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2c8fa51a9e4492ad39e7e90d856e8b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:05.051612 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2c8fa51a9e4492ad39e7e90d856e8b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:05.065221 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1431/2889] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:58:04 2022] DELETE /identity/v3/users/af2c8fa51a9e4492ad39e7e90d856e8b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:05.069710 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:05.070193 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:05.070418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:05.090202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:05.091471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:05.151626 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1459/2890] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:05.162276 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:05.163814 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:05.222998 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bb281-c605-4519-9c98-dbb1858184d0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:05.226740 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:05.227350 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:05.227656 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:05.227930 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:05.237316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:05.238719 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:05.248351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1432/2891] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:05.757523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:05.758990 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:05.773050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590d288-c4de-42a3-92f4-258a4387a9ec None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:05.779372 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:05.780249 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:05.780526 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:05.780797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] PATH_INFO: `/v3/projects/b4402f84699e43eb948968cf5b8be84b` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:05.782001 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4402f84699e43eb948968cf5b8be84b)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:05.784046 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:05.910382 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4402f84699e43eb948968cf5b8be84b', 'request_id': 'req-c39b430f-6ef7-4cad-9325-d3dd12329120'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:05.925056 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4402f84699e43eb948968cf5b8be84b', 'request_id': 'req-c39b430f-6ef7-4cad-9325-d3dd12329120'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.027061 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4402f84699e43eb948968cf5b8be84b', 'request_id': 'req-c39b430f-6ef7-4cad-9325-d3dd12329120'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.038424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] The token cache is being invalidate because project b4402f84699e43eb948968cf5b8be84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:58:06.038717 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.039348 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.040940 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1460/2892] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:58:05 2022] DELETE /identity/v3/projects/b4402f84699e43eb948968cf5b8be84b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:06.045189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:06.057207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339db1c-f7d8-4a07-b2cb-351d8f0f2a6a service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:06.116248 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:06.116895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:06.117177 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:06.117451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] PATH_INFO: `/v3/users/316e8a995eec4c01adb22629aca690d2` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:06.118592 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=316e8a995eec4c01adb22629aca690d2)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:06.120544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:06.137579 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:06.333390 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316e8a995eec4c01adb22629aca690d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.333990 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316e8a995eec4c01adb22629aca690d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.349645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316e8a995eec4c01adb22629aca690d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.444267 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316e8a995eec4c01adb22629aca690d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.444904 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316e8a995eec4c01adb22629aca690d2'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:06.458912 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1433/2893] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:58:06 2022] DELETE /identity/v3/users/316e8a995eec4c01adb22629aca690d2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:06.857132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:06.858619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:06.872991 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b430f-6ef7-4cad-9325-d3dd12329120 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:06.907371 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:06.932833 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:06.933463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:06.933742 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:06.934014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] PATH_INFO: `/v3/projects/00677dec049b46c79f92e21b855ec9b6` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:06.935114 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=00677dec049b46c79f92e21b855ec9b6)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:06.937082 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:07.030381 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00677dec049b46c79f92e21b855ec9b6', 'request_id': 'req-32cdb638-8628-40cf-984b-cd8eb6982eba'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.037948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00677dec049b46c79f92e21b855ec9b6', 'request_id': 'req-32cdb638-8628-40cf-984b-cd8eb6982eba'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.107035 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00677dec049b46c79f92e21b855ec9b6', 'request_id': 'req-32cdb638-8628-40cf-984b-cd8eb6982eba'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.118136 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] The token cache is being invalidate because project 00677dec049b46c79f92e21b855ec9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:58:07.118423 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.119038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.120531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1461/2894] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:58:06 2022] DELETE /identity/v3/projects/00677dec049b46c79f92e21b855ec9b6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:07.124784 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:07.126179 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:07.139889 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27c7a2-6561-412b-bdfc-2e29fa259adb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:07.201937 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:07.202576 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:07.202857 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:07.203132 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] PATH_INFO: `/v3/users/54d1af42945849778922358cb4b30956` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:07.204279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d1af42945849778922358cb4b30956)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:07.206841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:07.414792 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d1af42945849778922358cb4b30956'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.415500 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d1af42945849778922358cb4b30956'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.428871 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d1af42945849778922358cb4b30956'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.543701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d1af42945849778922358cb4b30956'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.544343 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-c8cc54dd-0fab-4686-b69c-6179b12b65e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d1af42945849778922358cb4b30956'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:07.557925 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1434/2895] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:58:07 2022] DELETE /identity/v3/users/54d1af42945849778922358cb4b30956 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:08.019938 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:08.021391 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:08.036203 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb638-8628-40cf-984b-cd8eb6982eba admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:08.093887 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:08.094513 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.094790 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.095063 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] PATH_INFO: `/v3/projects/d7c91c2ab6f5434c83b7a7a720ea21d9` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.096396 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c91c2ab6f5434c83b7a7a720ea21d9)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:08.098293 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:08.250725 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c91c2ab6f5434c83b7a7a720ea21d9', 'request_id': 'req-d813ee6f-b706-45b7-942d-e6f5343fb437'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:08.257539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c91c2ab6f5434c83b7a7a720ea21d9', 'request_id': 'req-d813ee6f-b706-45b7-942d-e6f5343fb437'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:08.309452 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c91c2ab6f5434c83b7a7a720ea21d9', 'request_id': 'req-d813ee6f-b706-45b7-942d-e6f5343fb437'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:08.315305 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:08.321689 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] The token cache is being invalidate because project d7c91c2ab6f5434c83b7a7a720ea21d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:58:08.321977 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:08.322605 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-d813ee6f-b706-45b7-942d-e6f5343fb437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:08.324303 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1462/2896] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:58:08 2022] DELETE /identity/v3/projects/d7c91c2ab6f5434c83b7a7a720ea21d9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:08.329817 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831cac-4ea0-4980-ba10-0c7b2730377f None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.330277 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831cac-4ea0-4980-ba10-0c7b2730377f None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.330632 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831cac-4ea0-4980-ba10-0c7b2730377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.351755 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-c9831cac-4ea0-4980-ba10-0c7b2730377f None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:08.352960 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c9831cac-4ea0-4980-ba10-0c7b2730377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:08.362318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:08.412914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1435/2897] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:08.422157 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d14d-d94c-4c2f-a337-ba4e11ea51f5 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.422582 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d14d-d94c-4c2f-a337-ba4e11ea51f5 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.422889 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d14d-d94c-4c2f-a337-ba4e11ea51f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.443875 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-8ce0d14d-d94c-4c2f-a337-ba4e11ea51f5 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:08.444995 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-8ce0d14d-d94c-4c2f-a337-ba4e11ea51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:08.453230 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1463/2898] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:08.457651 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831cac-4ea0-4980-ba10-0c7b2730377f None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:08.467705 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831cac-4ea0-4980-ba10-0c7b2730377f None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:08.473029 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:08.473650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.473913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.474185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.474841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:58:08.475172 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:08.476841 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:08.489469 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1436/2899] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:58:08.493748 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d14d-d94c-4c2f-a337-ba4e11ea51f5 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:08.503922 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d14d-d94c-4c2f-a337-ba4e11ea51f5 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:08.508653 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:08.509261 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.509543 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.509819 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.510471 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:08.512466 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:08.603939 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1464/2900] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:58:08 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:58:08.605068 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:08.615645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa59932-523b-4e33-a9b0-fda9497349eb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:08.673266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:08.674524 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.674859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.675135 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] PATH_INFO: `/v3/users` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.675810 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:08.677820 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:08.781845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1437/2901] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:58:08 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 28 08:58:08.786531 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:08.796970 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385274-e7db-4a3f-beba-6bd08d01ae5c admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:08.802892 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:08.803524 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.803806 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.804080 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.804727 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:08.806345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:08.816507 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1465/2902] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:58:08.820572 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:08.832017 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e4c97-47d3-4b7a-bfdb-47d7b86d679a admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:08.837096 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42584272-1e8a-4d73-8913-1a9628a69cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:08.837722 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584272-1e8a-4d73-8913-1a9628a69cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.838007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584272-1e8a-4d73-8913-1a9628a69cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.838286 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584272-1e8a-4d73-8913-1a9628a69cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.838992 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42584272-1e8a-4d73-8913-1a9628a69cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:08.840681 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42584272-1e8a-4d73-8913-1a9628a69cb7 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:08.852103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1438/2903] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:58:08.856248 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:08.866239 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706b107-2a08-4f77-ace7-8f7efc367b97 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:08.870866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:08.871595 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:08.871879 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:08.872158 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] PATH_INFO: `/v3/projects/2c4445ee6f2f4b578ebba1dc102e6448/users/da415839301b47699586928837faca65/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:08.887652 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4445ee6f2f4b578ebba1dc102e6448, user_id=da415839301b47699586928837faca65, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:08.890301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:09.005493 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1466/2904] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:58:08 2022] PUT /identity/v3/projects/2c4445ee6f2f4b578ebba1dc102e6448/users/da415839301b47699586928837faca65/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:09.071801 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:09.072067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:09.072341 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:09.100213 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] MFA Rules not processed for user `da415839301b47699586928837faca65`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:09.101417 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:09.164322 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1439/2905] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:09.176539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:09.178225 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:09.239963 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d710-352a-4e05-ab4f-f9fc0c1f1286 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:09.243630 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0570ef979ab4073898635be3fbb8894', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:09.244226 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:09.244504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:09.244775 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:09.253183 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:09.254705 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:09.263872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1467/2906] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:19.161548 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:19.259695 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:30.632465 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:30.633931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:30.732507 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655501e3-2924-45b4-ad3d-da2ca6699ff2 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:30.737514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8683f-b454-41e5-9b7a-0efc75fbceda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:30.738117 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8683f-b454-41e5-9b7a-0efc75fbceda service placement] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:30.738396 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8683f-b454-41e5-9b7a-0efc75fbceda service placement] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:30.738666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8683f-b454-41e5-9b7a-0efc75fbceda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:30.740370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-53f8683f-b454-41e5-9b7a-0efc75fbceda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:30.752663 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8683f-b454-41e5-9b7a-0efc75fbceda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:30.754249 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8683f-b454-41e5-9b7a-0efc75fbceda service placement] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:30.764624 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1440/2907] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:36.049383 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:36.111240 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57db37-930d-4638-a554-e53a433a71f0 service glance] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:36.115865 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:36.116488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:36.116766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:36.117041 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] PATH_INFO: `/v3/users/da415839301b47699586928837faca65` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:36.118144 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da415839301b47699586928837faca65)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:36.120284 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:36.311459 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da415839301b47699586928837faca65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:36.312050 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da415839301b47699586928837faca65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:36.323949 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da415839301b47699586928837faca65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:36.411795 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da415839301b47699586928837faca65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:36.412415 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da415839301b47699586928837faca65'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:36.425107 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1468/2908] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:58:36 2022] DELETE /identity/v3/users/da415839301b47699586928837faca65 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:36.429630 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:36.430097 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:36.430207 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:36.449796 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:36.450974 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:36.512931 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1441/2909] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:36.522839 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:36.524310 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:36.581101 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cff40-538d-4f37-9569-dab320f1c135 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:36.584805 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893005ec-9ee7-420e-a369-a340dd8dad7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:36.585397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893005ec-9ee7-420e-a369-a340dd8dad7b service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:36.585673 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893005ec-9ee7-420e-a369-a340dd8dad7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:36.585945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893005ec-9ee7-420e-a369-a340dd8dad7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:36.596955 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893005ec-9ee7-420e-a369-a340dd8dad7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:36.599724 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893005ec-9ee7-420e-a369-a340dd8dad7b service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:36.608590 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1469/2910] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:37.114430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:37.115962 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:37.130099 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859b796-7997-4359-bdc5-667818aa30f4 None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:37.134972 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:37.142264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.142264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.142264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] PATH_INFO: `/v3/projects/2c4445ee6f2f4b578ebba1dc102e6448` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.142264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4445ee6f2f4b578ebba1dc102e6448)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:37.142264 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:37.271189 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4445ee6f2f4b578ebba1dc102e6448', 'request_id': 'req-4da77f9b-3585-4e33-b7a8-8490ef60162e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:37.277430 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4445ee6f2f4b578ebba1dc102e6448', 'request_id': 'req-4da77f9b-3585-4e33-b7a8-8490ef60162e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:37.358225 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4445ee6f2f4b578ebba1dc102e6448', 'request_id': 'req-4da77f9b-3585-4e33-b7a8-8490ef60162e'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:37.362586 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:37.369738 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] The token cache is being invalidate because project 2c4445ee6f2f4b578ebba1dc102e6448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:58:37.370021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:37.370680 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-4da77f9b-3585-4e33-b7a8-8490ef60162e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:37.372873 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1442/2911] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:58:37 2022] DELETE /identity/v3/projects/2c4445ee6f2f4b578ebba1dc102e6448 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:37.378585 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5111d19-0bc6-4bb4-9d91-16bdc23a9091 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.379084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5111d19-0bc6-4bb4-9d91-16bdc23a9091 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.379187 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5111d19-0bc6-4bb4-9d91-16bdc23a9091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.399594 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-f5111d19-0bc6-4bb4-9d91-16bdc23a9091 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:37.400820 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-f5111d19-0bc6-4bb4-9d91-16bdc23a9091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:37.417418 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:37.462555 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1470/2912] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:37.470471 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24956d-f405-4158-bfab-a47d9d0d403d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.470943 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24956d-f405-4158-bfab-a47d9d0d403d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.471059 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24956d-f405-4158-bfab-a47d9d0d403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.491297 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-7f24956d-f405-4158-bfab-a47d9d0d403d None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:37.492525 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-7f24956d-f405-4158-bfab-a47d9d0d403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:37.501293 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1443/2913] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:37.505586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5111d19-0bc6-4bb4-9d91-16bdc23a9091 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:37.515719 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5111d19-0bc6-4bb4-9d91-16bdc23a9091 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:37.521212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:37.521212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.521212 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.521539 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.522068 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 28 08:58:37.522363 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:37.523971 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:37.535994 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1471/2914] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 28 08:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 28 08:58:37.540239 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24956d-f405-4158-bfab-a47d9d0d403d None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:37.550112 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24956d-f405-4158-bfab-a47d9d0d403d None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:37.554850 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:37.555533 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.555815 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.556086 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.556711 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:37.558900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:37.664406 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1444/2915] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 28 08:58:37 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:58:37.669229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:37.679031 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca33a-5cf5-480c-80da-743b6efff4ef admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:37.735564 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:37.736163 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.736439 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.736708 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.737327 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:37.739299 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:37.829580 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1472/2916] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 28 08:58:37 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 28 08:58:37.834070 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:37.844927 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322f4de-9f13-40e5-b7c2-4cd34e014bf1 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:37.849425 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:37.850028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.850353 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.850627 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.851262 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:37.852859 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:37.863490 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1445/2917] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:58:37.872304 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:37.882180 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b6c5-4add-4237-8545-4012e6c3a4e0 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:37.887575 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a338-094e-44a1-9e3f-2bf4c8c9d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:37.888164 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a338-094e-44a1-9e3f-2bf4c8c9d9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.888445 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a338-094e-44a1-9e3f-2bf4c8c9d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.888718 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a338-094e-44a1-9e3f-2bf4c8c9d9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.889355 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a338-094e-44a1-9e3f-2bf4c8c9d9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:37.890928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a338-094e-44a1-9e3f-2bf4c8c9d9cf admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:37.901343 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1473/2918] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 28 08:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 28 08:58:37.906067 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:37.917488 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3b274-edb8-4669-b724-6796cb0d57c0 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:37.922188 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:37.922867 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:37.923167 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:37.923655 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] PATH_INFO: `/v3/projects/d9f19b0094dc4c3788b5210aacee11de/users/9bdfcf3e141c4864a5cabf934f86bc6b/roles/23ec368052424f10b0ffccb344cf6b5c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:37.938106 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f19b0094dc4c3788b5210aacee11de, user_id=9bdfcf3e141c4864a5cabf934f86bc6b, role_id=23ec368052424f10b0ffccb344cf6b5c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:37.940759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:38.009539 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1446/2919] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 28 08:58:37 2022] PUT /identity/v3/projects/d9f19b0094dc4c3788b5210aacee11de/users/9bdfcf3e141c4864a5cabf934f86bc6b/roles/23ec368052424f10b0ffccb344cf6b5c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:38.021670 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315bae-feca-4ebc-8628-ae2570fe1812 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:38.021958 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315bae-feca-4ebc-8628-ae2570fe1812 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:38.022229 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315bae-feca-4ebc-8628-ae2570fe1812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:38.053005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-04315bae-feca-4ebc-8628-ae2570fe1812 None None] MFA Rules not processed for user `9bdfcf3e141c4864a5cabf934f86bc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:38.053005 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-04315bae-feca-4ebc-8628-ae2570fe1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:38.121038 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1474/2920] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:38.132197 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:38.133882 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:38.208848 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb3622-b201-452c-8793-23689fa74e75 admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:38.212900 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd053a3f1d07641b586518ae0c0a39e4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:38.213728 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:38.214007 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:38.214307 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:38.228145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:38.228145 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:38.234636 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1447/2921] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:40.042350 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325038c-8fa3-4901-8195-ef36f2a3f65a None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:40.042885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325038c-8fa3-4901-8195-ef36f2a3f65a None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:40.042885 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325038c-8fa3-4901-8195-ef36f2a3f65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:40.063745 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-b325038c-8fa3-4901-8195-ef36f2a3f65a None None] MFA Rules not processed for user `9bdfcf3e141c4864a5cabf934f86bc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:40.064936 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b325038c-8fa3-4901-8195-ef36f2a3f65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:40.071883 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1475/2922] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:40.530660 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:40.532063 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:40.603688 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18211a-1d7b-43cc-ac25-dc16ed996188 service cinder] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:40.609116 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:40.609759 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:40.610042 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:40.610318 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] PATH_INFO: `/v3/users/9f8169022e17425cbe5d57afd1e3fe13` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:40.611504 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8169022e17425cbe5d57afd1e3fe13)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:40.613437 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:40.801997 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:40.811668 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8169022e17425cbe5d57afd1e3fe13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:40.812351 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8169022e17425cbe5d57afd1e3fe13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:40.824081 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8169022e17425cbe5d57afd1e3fe13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:40.963773 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8169022e17425cbe5d57afd1e3fe13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:40.964573 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8169022e17425cbe5d57afd1e3fe13'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:40.979600 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1448/2923] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:58:40 2022] DELETE /identity/v3/users/9f8169022e17425cbe5d57afd1e3fe13 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:40.988542 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:40.988850 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:40.989253 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:41.008433 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:58:41.009690 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:41.020009 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:41.071573 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1476/2924] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:58:41.081751 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:41.083523 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:41.140590 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eae019-03f2-410d-b2bc-64d202fa6cad admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:41.144603 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:41.145216 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:41.145496 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:41.145769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:41.154767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:41.156793 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:41.167357 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1449/2925] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:41.661403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:41.661403 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:41.677210 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34029ca6-8adb-40ca-b1ae-94190acf52c7 None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:41.683130 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:41.683566 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:41.688561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:41.688561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] PATH_INFO: `/v3/projects/b70b3ec9308e405289877ebbce0404c5` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:41.688561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70b3ec9308e405289877ebbce0404c5)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:41.688561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:41.812786 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70b3ec9308e405289877ebbce0404c5', 'request_id': 'req-c47cd282-5c67-44d8-b191-6da64701fc40'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:41.820578 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70b3ec9308e405289877ebbce0404c5', 'request_id': 'req-c47cd282-5c67-44d8-b191-6da64701fc40'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:41.900574 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70b3ec9308e405289877ebbce0404c5', 'request_id': 'req-c47cd282-5c67-44d8-b191-6da64701fc40'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:41.913561 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] The token cache is being invalidate because project b70b3ec9308e405289877ebbce0404c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:58:41.913948 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:41.915119 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:58:41.916916 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1477/2926] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:58:41 2022] DELETE /identity/v3/projects/b70b3ec9308e405289877ebbce0404c5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:58:47.059186 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:47.060617 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:47.072824 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58965b5e-c62b-4b14-9d89-9f71c4da09c0 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:47.127650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9b8bf-326f-4eed-91ae-42eacb32baae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:47.128274 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9b8bf-326f-4eed-91ae-42eacb32baae service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:47.128554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9b8bf-326f-4eed-91ae-42eacb32baae service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:47.128828 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9b8bf-326f-4eed-91ae-42eacb32baae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:47.130584 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-f7b9b8bf-326f-4eed-91ae-42eacb32baae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:47.143618 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9b8bf-326f-4eed-91ae-42eacb32baae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:47.145130 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9b8bf-326f-4eed-91ae-42eacb32baae service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:47.153679 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1450/2927] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:47.242400 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:58:47.244088 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:47.256427 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd282-5c67-44d8-b191-6da64701fc40 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:58:47.259951 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:58:47.260547 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:58:47.260828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:58:47.261104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:58:47.262807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:58:47.354528 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:58:47.356006 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:58:47.367504 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:47.376809 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1478/2928] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:58:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:58:57.149892 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=68,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:57.960147 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:59:00.257481 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bef6ee-e490-48d7-b3df-e2765e999378 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:00.258021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bef6ee-e490-48d7-b3df-e2765e999378 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:00.258021 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bef6ee-e490-48d7-b3df-e2765e999378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:00.277819 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-43bef6ee-e490-48d7-b3df-e2765e999378 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:59:00.279006 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-43bef6ee-e490-48d7-b3df-e2765e999378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:00.333333 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1451/2929] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:59:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:59:00.480987 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:59:00.482397 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:00.549804 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7de67-a9b9-4b08-9efc-bb0189d339ca service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:59:00.554752 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:59:00.555345 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:00.555654 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:00.555929 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:00.563844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:59:00.565420 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:59:00.573283 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1479/2930] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:59:01.338519 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4e6e7-1147-48ce-944c-66b25026bff4 None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:01.342266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4e6e7-1147-48ce-944c-66b25026bff4 None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:01.342266 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4e6e7-1147-48ce-944c-66b25026bff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:01.359908 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-a1b4e6e7-1147-48ce-944c-66b25026bff4 None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:59:01.361102 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-a1b4e6e7-1147-48ce-944c-66b25026bff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:01.368518 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1452/2931] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 28 08:59:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:59:01.381871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:59:01.392308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376846-223c-41a9-86f6-8aeb1bdae2cd service swift] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:59:01.397410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:59:01.398000 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:01.398276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:01.398583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:01.407464 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:59:01.409237 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:59:01.417309 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1480/2932] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 28 08:59:02.127089 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d800-ee6e-4942-bf2e-32af65c7661d None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:02.127370 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d800-ee6e-4942-bf2e-32af65c7661d None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:02.127678 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92d800-ee6e-4942-bf2e-32af65c7661d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:02.146897 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-4c92d800-ee6e-4942-bf2e-32af65c7661d None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:59:02.148120 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-4c92d800-ee6e-4942-bf2e-32af65c7661d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:02.155237 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1453/2933] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 28 08:59:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:59:02.167104 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:59:02.177740 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b27d8-3609-402d-a4e7-1da4f75be44b service swift] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:59:02.182703 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:59:02.183289 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:02.183601 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:02.183881 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:02.192281 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:59:02.193844 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:59:02.201777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1481/2934] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:59:02.788563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] REQUEST_METHOD: `POST` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:02.789045 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:02.789185 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:02.810708 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.auth.core [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] MFA Rules not processed for user `a5f192aca43c40508a5f8fb9611bf5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:59:02.811914 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:02.819452 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1454/2935] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 28 08:59:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:59:02.831480 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:59:02.842188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eed90-197f-4ea6-9df4-09105fe868f7 service swift] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:59:02.847871 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a1d36-2fba-4364-8e34-8ec3f5d89c76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6717f091388748d8aad2eafcb50fd61a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:59:02.848491 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1d36-2fba-4364-8e34-8ec3f5d89c76 service swift] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:02.848771 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1d36-2fba-4364-8e34-8ec3f5d89c76 service swift] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:02.849044 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a1d36-2fba-4364-8e34-8ec3f5d89c76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:02.856872 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a1d36-2fba-4364-8e34-8ec3f5d89c76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:59:02.858455 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a1d36-2fba-4364-8e34-8ec3f5d89c76 service swift] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:59:02.866919 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1482/2936] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 28 08:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 28 08:59:05.540124 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:59:05.541521 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:05.607316 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9695-1d2b-4331-a6ee-e8007f866c9e None None] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:59:05.612337 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:59:05.613000 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:05.613279 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:05.613581 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] PATH_INFO: `/v3/users/9bdfcf3e141c4864a5cabf934f86bc6b` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:05.614737 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bdfcf3e141c4864a5cabf934f86bc6b)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:59:05.616666 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:59:05.787506 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdfcf3e141c4864a5cabf934f86bc6b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:05.788103 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdfcf3e141c4864a5cabf934f86bc6b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:05.800701 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdfcf3e141c4864a5cabf934f86bc6b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:05.870606 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdfcf3e141c4864a5cabf934f86bc6b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:05.871226 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdfcf3e141c4864a5cabf934f86bc6b'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:05.883761 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1455/2937] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 08:59:05 2022] DELETE /identity/v3/users/9bdfcf3e141c4864a5cabf934f86bc6b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:59:05.888308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] REQUEST_METHOD: `POST` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:05.888807 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:05.888913 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:05.909016 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.auth.core [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] MFA Rules not processed for user `b229946b8c534cd194a31028b1b40cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 28 08:59:05.910308 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:05.968095 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1483/2938] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 28 08:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 28 08:59:05.978233 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:59:05.979664 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:05.986845 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:59:06.036945 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c5dec-a225-4915-a206-c62057bcc7bb admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:59:06.040649 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:59:06.041258 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:06.041767 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:06.042224 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:06.052462 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:59:06.053877 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:59:06.063176 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1456/2939] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 08:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 08:59:06.336586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 08:59:06.338084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 08:59:06.356797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c07395-2f8c-4e12-8131-d3db030d63ae None None] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 08:59:06.356797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 08:59:06.356797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 08:59:06.356797 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 08:59:06.357236 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] PATH_INFO: `/v3/projects/d9f19b0094dc4c3788b5210aacee11de` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 08:59:06.357772 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f19b0094dc4c3788b5210aacee11de)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 08:59:06.359707 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 08:59:06.464132 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:59:06.466960 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f19b0094dc4c3788b5210aacee11de', 'request_id': 'req-6d0423d8-5bd2-4347-b5bb-dbd230557535'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:06.473866 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f19b0094dc4c3788b5210aacee11de', 'request_id': 'req-6d0423d8-5bd2-4347-b5bb-dbd230557535'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:06.542894 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f19b0094dc4c3788b5210aacee11de', 'request_id': 'req-6d0423d8-5bd2-4347-b5bb-dbd230557535'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:06.554014 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] The token cache is being invalidate because project d9f19b0094dc4c3788b5210aacee11de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 08:59:06.554301 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:06.554914 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 08:59:06.556488 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1484/2940] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 08:59:06 2022] DELETE /identity/v3/projects/d9f19b0094dc4c3788b5210aacee11de => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 08:59:16.070803 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=24 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:59:16.551178 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 09:00:11.237514 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:11.240395 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:11.337823 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc68dd7-5d09-4d25-b9e5-bb75d163fda9 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:11.404703 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0969ec55ae1244c09694079a72bf8310', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:11.405327 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:11.405614 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:11.405918 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:11.407720 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:11.421898 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:11.426650 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:11.435860 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1457/2941] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 09:00:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 09:00:11.511279 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:11.512789 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:11.575179 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0423d8-5bd2-4347-b5bb-dbd230557535 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:11.582010 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:11.582644 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:11.582928 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:11.583271 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:11.585826 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:11.597177 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:11.598721 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:11.608523 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1485/2942] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 09:00:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 09:00:11.654005 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:11.656509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:11.669895 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828109eb-3b66-4bce-b2a6-fd6c082081ba service nova] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:11.673645 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:11.674259 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:11.674544 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:11.674822 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:11.677215 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:11.693315 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:11.695152 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:11.707334 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1458/2943] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 09:00:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 09:00:12.899586 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:12.908500 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfcde6-f3c8-4ad0-9b16-009c4edcd688 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:12.914583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5523644021bf4d91a3a9246bee763b6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:12.914583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:12.914583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:12.914583 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:12.916084 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:12.931728 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:12.933172 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:12.946770 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1486/2944] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 09:00:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 09:00:20.179074 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:20.181623 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:20.260028 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b9e4-c327-43df-b58c-e032035fb8b2 service neutron] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:20.265473 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:20.266084 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] REQUEST_METHOD: `GET` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:20.266368 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:20.266629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:20.268451 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:20.280782 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:20.282344 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:20.287769 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=100 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 09:00:20.292950 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1459/2945] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 09:00:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 09:00:22.940760 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=32 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 09:00:23.764738 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:23.766276 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:23.831463 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7af7f5-6104-4822-a511-cdce90ce13d3 service neutron] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:23.835925 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:23.836551 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:23.836828 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:23.837100 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] PATH_INFO: `/v3/users/134a05b72b5c403d88f2e0c2034532d6` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:23.838221 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134a05b72b5c403d88f2e0c2034532d6)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:23.840165 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:24.064131 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134a05b72b5c403d88f2e0c2034532d6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.064810 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134a05b72b5c403d88f2e0c2034532d6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.077036 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134a05b72b5c403d88f2e0c2034532d6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.136231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134a05b72b5c403d88f2e0c2034532d6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.136848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134a05b72b5c403d88f2e0c2034532d6'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.157328 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1487/2946] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 09:00:23 2022] DELETE /identity/v3/users/134a05b72b5c403d88f2e0c2034532d6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 09:00:24.407035 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:24.418959 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde01c1-61c3-457e-8678-db9d1d4b2dce service placement] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:24.481509 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:24.482153 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:24.482435 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:24.482712 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] PATH_INFO: `/v3/projects/cf8d98d2065e4bef83b4f21a8b421110` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:24.483876 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8d98d2065e4bef83b4f21a8b421110)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:24.485766 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:24.606108 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8d98d2065e4bef83b4f21a8b421110', 'request_id': 'req-b23d784e-f69c-42be-b577-96af3febbc6f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.612211 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8d98d2065e4bef83b4f21a8b421110', 'request_id': 'req-b23d784e-f69c-42be-b577-96af3febbc6f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.685497 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8d98d2065e4bef83b4f21a8b421110', 'request_id': 'req-b23d784e-f69c-42be-b577-96af3febbc6f'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.700629 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] The token cache is being invalidate because project cf8d98d2065e4bef83b4f21a8b421110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 09:00:24.700913 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.701547 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.703027 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1460/2947] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 09:00:24 2022] DELETE /identity/v3/projects/cf8d98d2065e4bef83b4f21a8b421110 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 09:00:24.707535 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:24.708945 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:24.722410 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb66da7-779c-4482-b95a-b6e1b59f3f96 admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:24.778352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:24.779007 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:24.779262 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:24.779572 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] PATH_INFO: `/v3/users/6d50a984ecc045a0bfb0482c4789af29` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:24.780704 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d50a984ecc045a0bfb0482c4789af29)` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:24.782619 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:24.804890 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 09:00:24.986766 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d50a984ecc045a0bfb0482c4789af29'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:24.987352 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d50a984ecc045a0bfb0482c4789af29'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.000424 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d50a984ecc045a0bfb0482c4789af29'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.084202 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d50a984ecc045a0bfb0482c4789af29'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.084814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.notifications [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d50a984ecc045a0bfb0482c4789af29'} {{(pid=81845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.097201 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1488/2948] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 28 09:00:24 2022] DELETE /identity/v3/users/6d50a984ecc045a0bfb0482c4789af29 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 09:00:25.332288 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Authenticating user token {{(pid=81844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:00:25.333694 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.fernet_utils [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:00:25.351580 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d784e-f69c-42be-b577-96af3febbc6f admin admin] Validating token access rules against request {{(pid=81844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:00:25.412563 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229946b8c534cd194a31028b1b40cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42006892efe04f19b84a31bfb4dc5f4b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:00:25.413214 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:00:25.413456 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:00:25.413727 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] PATH_INFO: `/v3/projects/2c833bc91ba544daa213f4874323d94c` {{(pid=81844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:00:25.414838 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c833bc91ba544daa213f4874323d94c)` {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:00:25.417253 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] RBAC: Authorization granted {{(pid=81844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:00:25.542921 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 09:00:25.554242 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c833bc91ba544daa213f4874323d94c', 'request_id': 'req-bfb93103-1761-4653-9813-5a024aa1f9a8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.560554 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c833bc91ba544daa213f4874323d94c', 'request_id': 'req-bfb93103-1761-4653-9813-5a024aa1f9a8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.668403 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c833bc91ba544daa213f4874323d94c', 'request_id': 'req-bfb93103-1761-4653-9813-5a024aa1f9a8'} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.679031 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] The token cache is being invalidate because project 2c833bc91ba544daa213f4874323d94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 28 09:00:25.679593 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.680700 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG keystone.notifications [None req-bfb93103-1761-4653-9813-5a024aa1f9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 28 09:00:25.682308 dv-cinder-844563-8-smb devstack@keystone.service[81844]: [pid: 81844|app: 0|req: 1461/2949] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 28 09:00:25 2022] DELETE /identity/v3/projects/2c833bc91ba544daa213f4874323d94c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 28 09:00:35.093763 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 09:00:35.799397 dv-cinder-844563-8-smb devstack@keystone.service[81844]: DEBUG dbcounter [-] [81844] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 09:03:37.610848 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Authenticating user token {{(pid=81845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 28 09:03:37.612357 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:03:37.681071 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a14de-a20c-4a58-a41d-53ab0788c85d admin admin] Validating token access rules against request {{(pid=81845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 28 09:03:37.739577 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78e950-a017-489c-bb43-6664c87a7a34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b79ca72535543aeac33b949189ee4da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b91e255418634b46b675b95be1320ec9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 28 09:03:37.740188 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e950-a017-489c-bb43-6664c87a7a34 service placement] REQUEST_METHOD: `GET` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 28 09:03:37.740468 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e950-a017-489c-bb43-6664c87a7a34 service placement] SCRIPT_NAME: `/identity` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 28 09:03:37.740814 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e950-a017-489c-bb43-6664c87a7a34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 28 09:03:37.742777 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.fernet_utils [None req-2b78e950-a017-489c-bb43-6664c87a7a34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 28 09:03:37.755043 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78e950-a017-489c-bb43-6664c87a7a34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 28 09:03:37.757320 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78e950-a017-489c-bb43-6664c87a7a34 service placement] RBAC: Authorization granted {{(pid=81845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 28 09:03:37.767508 dv-cinder-844563-8-smb devstack@keystone.service[81845]: [pid: 81845|app: 0|req: 1489/2950] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 28 09:03:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 28 09:03:47.763231 dv-cinder-844563-8-smb devstack@keystone.service[81845]: DEBUG dbcounter [-] [81845] Writing DB stats keystone:SELECT=58 {{(pid=81845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}